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Preface 


CMMI®  (Capability  Maturity  Model®  Integration)  models  are  collections  of 
best  practices  that  help  organizations  to  improve  their  processes.  These 
models  are  developed  by  product  teams  with  members  from  industry, 
government,  and  the  Software  Engineering  Institute  (SEI). 

This  model,  called  CMMI  for  Acquisition  (CMMI-ACQ),  provides  a 
comprehensive  integrated  set  of  guidelines  for  acquiring  products  and 
services. 


Purpose 


The  CMMI-ACQ  model  provides  guidance  for  applying  CMMI  best  practices 
in  an  acquiring  organization.  Best  practices  in  the  model  focus  on  activities 
for  initiating  and  managing  the  acquisition  of  products  and  services  to  meet 
the  needs  of  customers  and  end  users.  Although  suppliers  can  provide 
artifacts  useful  to  the  processes  addressed  in  CMMI-ACQ,  the  focus  of  the 
model  is  on  the  processes  of  the  acquirer. 

The  CMMI-ACQ,  VI  .3  model  is  a  collection  of  acquisition  best  practices 
from  government  and  industry  that  is  generated  from  the  CMMI  VI  .3 
Architecture  and  Framework.1  CMMI-ACQ  is  based  on  the  CMMI  Model 
Foundation  or  CMF  (i.e.,  model  components  common  to  all  CMMI  models 
and  constellations2),  the  CMMI  Acquisition  Module,  and  the  Software 
Acquisition  Capability  Maturity  Model  (SA-CMM)  [SEI  2002], CMMI-ACQ 
also  incorporates  work  by  acquisition  organizations  to  adapt  CMMI  for  use 
in  an  acquisition  organization. 

CMMI-ACQ  provides  a  comprehensive  set  of  best  practices  for  acquiring 
products  and  services.  CMMI  for  Development  (CMMI-DEV)  can  be  treated 
as  a  reference  for  supplier  executed  activities  in  an  acquisition  initiative  [SEI 
2010a].  In  those  cases  where  the  acquirer  also  has  a  role  as  a  product  or 
service  developer  (e.g.,  taking  responsibility  for  the  first  few  layers  of 
product  development  and  integration),  CMMI-DEV  (in  particular  the 
Requirements  Development,  Technical  Solution,  and  Product  Integration 
process  areas)  should  also  be  used  to  improve  the  acquirer’s  product  or 
service  development  processes. 


The  CMMI  Framework  is  the  basic  structure  that  organizes  CMMI  components  and  combines  them  into  CMMI  constellations 
and  models. 

A  constellation  is  a  collection  of  CMMI  components  that  are  used  to  construct  models,  training  materials,  and  appraisal  related 
documents  for  an  area  of  interest  (e.g.,  development,  acquisition,  services). 
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Audience 


The  audience  for  CMMI-ACQ  includes  anyone  interested  in  process 
improvement  in  an  acquisition  environment.  Whether  you  are  familiar  with 
the  concept  of  Capability  Maturity  Models  or  are  seeking  information  to 
begin  improving  your  acquisition  processes,  CMMI-ACQ  will  be  useful  to 
you.  This  model  is  also  intended  for  organizations  that  want  to  use  a 
reference  model  for  an  appraisal  of  their  acquisition  related  processes.3 


Organization  of  this  Document 

This  document  is  organized  into  three  main  parts: 

•  Part  One:  About  CMMI  for  Acquisition 

•  Part  Two:  Generic  Goals  and  Generic  Practices,  and  the  Process  Areas 

•  Part  Three:  The  Appendices  and  Glossary 


An  appraisal  is  an  examination  of  one  or  more  processes  by  a  trained  team  of  professionals  using  a  reference  model  (e.g., 
CMMI-ACQ)  as  the  basis  for  determining  strengths  and  weaknesses. 
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Part  One:  About  CMMI  for  Acquisition,  consists  of  five  chapters: 

•  Chapter  1 ,  Introduction,  offers  a  broad  view  of  CMMI  and  the 
Acquisition  constellation,  concepts  of  process  improvement,  and  the 
history  of  models  used  for  process  improvement  and  different  process 
improvement  approaches. 

•  Chapter  2,  Process  Area  Components,  describes  all  of  the  components 
of  the  CMMI-ACQ  process  areas.4 

•  Chapter  3,  Tying  It  All  Together,  assembles  the  model  components  and 
explains  the  concepts  of  maturity  levels  and  capability  levels. 

•  Chapter  4,  Relationships  Among  Process  Areas,  provides  insight  into 
the  meaning  and  interactions  among  the  CMMI-ACQ  process  areas. 

•  Chapter  5,  Using  CMMI  Models,  describes  paths  to  adoption  and  the 
use  of  CMMI-ACQ  for  process  improvement  and  benchmarking  of 
practices  in  an  acquisition  organization. 

Part  Two:  Generic  Goals  and  Generic  Practices,  and  the  Process  Areas, 
contains  all  of  this  CMMI  model’s  required  and  expected  components.  It 
also  contains  related  informative  components,  including  subpractices, 
notes,  examples,  and  example  work  products. 

Part  Two  contains  23  sections.  The  first  section  contains  the  generic  goals 
and  practices.  The  remaining  22  sections  each  represent  one  of  the  CMMI- 
ACQ  process  areas. 

To  make  these  process  areas  easy  to  find,  they  are  organized 
alphabetically  by  process  area  acronym.  Each  section  contains  descriptions 
of  goals,  best  practices,  and  examples. 

Part  Three:  The  Appendices  and  Glossary,  consists  of  four  sections: 

•  Appendix  A:  References,  contains  references  you  can  use  to  locate 
documented  sources  of  information  such  as  reports,  process 
improvement  models,  industry  standards,  and  books  that  are  related  to 
CMMI-ACQ. 

•  Appendix  B:  Acronyms,  defines  the  acronyms  used  in  the  model. 

•  Appendix  C:  CMMI  Version  1 .3  Project  Participants,  contains  lists  of 
team  members  who  participated  in  the  development  of  CMMI-ACQ, 

VI  .3. 

•  Appendix  D:  Glossary,  defines  many  of  the  terms  used  in  CMMI-ACQ. 


A  process  area  is  a  cluster  of  related  practices  in  an  area  that,  when  implemented  collectively,  satisfies  a  set  of  goals 
considered  important  for  making  improvement  in  that  area.  This  concept  is  covered  in  detail  in  Chapter  2. 
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How  to  Use  this  Document 


Whether  you  are  new  to  process  improvement,  new  to  CMMI,  or  already 
familiar  with  CMMI,  Part  One  can  help  you  understand  why  CMMI-ACQ  is 
the  model  to  use  for  improving  your  acquisition  processes. 

Readers  New  to  Process  Improvement 

If  you  are  new  to  process  improvement  or  new  to  the  Capability  Maturity 
Model  (CMM®)  concept,  we  suggest  that  you  read  Chapter  1  first.  Chapter  1 
contains  an  overview  of  process  improvement  that  explains  what  CMMI  is 
all  about. 

Next,  skim  Part  Two,  including  generic  goals  and  practices  and  specific 
goals  and  practices,  to  get  a  feel  for  the  scope  of  the  best  practices 
contained  in  the  model.  Pay  close  attention  to  the  purpose  and  introductory 
notes  at  the  beginning  of  each  process  area. 

In  Part  Three,  look  through  the  references  in  Appendix  A  and  select 
additional  sources  you  think  would  be  beneficial  to  read  before  moving 
forward  with  using  CMMI-ACQ.  Read  through  the  acronyms  and  glossary  to 
become  familiar  with  the  language  of  CMMI.  Then,  go  back  and  read  the 
details  of  Part  Two. 

Readers  Experienced  with  Process  Improvement 

If  you  are  new  to  CMMI  but  have  experience  with  other  process 
improvement  models,  such  as  the  Software  Acquisition  CMM,  you  will 
immediately  recognize  many  similarities  in  their  structure  and  content  [SEI 
2002], 

We  recommend  that  you  read  Part  One  to  understand  how  CMMI  is 
different  from  other  process  improvement  models.  If  you  have  experience 
with  other  models,  you  may  want  to  select  which  sections  to  read  first.  Read 
Part  Two  with  an  eye  for  best  practices  you  recognize  from  the  models  that 
you  have  already  used.  By  identifying  familiar  material,  you  will  gain  an 
understanding  of  what  is  new,  what  has  been  carried  over,  and  what  is 
familiar  from  the  models  you  already  know. 

Next,  review  the  glossary  to  understand  how  some  terminology  can  differ 
from  that  used  in  the  process  improvement  models  you  know.  Many 
concepts  are  repeated,  but  they  may  be  called  something  different. 

Readers  Familiar  with  CMMI 

If  you  have  reviewed  or  used  a  CMMI  model  before,  you  will  quickly 
recognize  the  CMMI  concepts  discussed  and  the  best  practices  presented. 
As  always,  the  improvements  that  the  CMMI  Product  Team  made  to  CMMI 
for  the  VI  .3  release  were  driven  by  user  input.  Change  requests  were 
carefully  considered,  analyzed,  and  implemented. 
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Some  significant  improvements  you  can  expect  in  CMMI-ACQ,  VI. 3  include 

the  following: 

•  High  maturity  process  areas  are  significantly  improved  to  reflect 
industry  best  practices,  including  a  new  specific  goal  and  several  new 
specific  practices  in  the  process  area  that  was  renamed  from 
Organizational  Innovation  and  Deployment  (OID)  to  Organizational 
Performance  Management  (OPM). 

•  Improvements  were  made  to  the  model  architecture  that  simplify  the 
use  of  multiple  models. 

•  The  informative  material  was  improved,  including  adding  guidance 
about  using  preferred  suppliers  in  SSAD  and  AM. 

•  Glossary  definitions  and  model  terminology  were  improved  to  enhance 
the  clarity,  accuracy,  and  usability  of  the  model. 

•  The  level  4  and  5  generic  goals  and  practices  were  eliminated  as  well 
as  capability  levels  4  and  5  to  appropriately  focus  high  maturity  on  the 
achievement  of  business  objectives,  which  is  accomplished  by  applying 
capability  level  1-3  to  the  high  maturity  process  areas  (Causal  Analysis 
and  Resolution,  Quantitative  Project  Management,  Organizational 
Performance  Management,  and  Organizational  Process  Performance). 

For  a  more  complete  and  detailed  list  of  improvements,  see 

http://www.sei.cmu.edu/cmmi/tools/cmmiv1-3/. 


Additional  Information  and  Reader  Feedback 


Many  sources  of  information  about  CMMI  are  listed  in  Appendix  A  and  are 
also  published  on  the  CMMI  website — http://www.sei.cmu.edu/cmmi/. 

Your  suggestions  for  improving  CMMI  are  welcome.  For  information  on  how 
to  provide  feedback,  see  the  CMMI  website  at 

http://www.sei.cmu.edu/cmmi/tools/cr/.  If  you  have  questions  about  CMMI, 
send  email  to  cmmi-comments@sei.cmu.edu. 


Preface 


v 


CMMI  for  Acquisition,  Version  1.3 


VI 


Preface 


CMMI  for  Acquisition,  Version  1.3 


Table  of  Contents 

Preface  i 

Purpose  i 

Acknowledgments  ii 

Audience  ii 

Organization  of  this  Document  ii 

How  to  Use  this  Document  iv 

Readers  New  to  Process  Improvement  iv 

Readers  Experienced  with  Process  Improvement  iv 

Readers  Familiar  with  CMMI  iv 

Additional  Information  and  Reader  Feedback  v 

Part  One:  About  CMMI  for  Acquisition  1 

1  Introduction  3 

About  Process  Improvement  4 

About  Capability  Maturity  Models  5 

Evolution  of  CMMI  6 

CMMI  Framework  8 

CMMI  for  Acquisition  8 

2  Process  Area  Components  1 1 

Core  Process  Areas  and  CMMI  Models  1 1 

Required,  Expected,  and  Informative  Components  1 1 

Required  Components  11 

Expected  Components  1 1 

Informative  Components  12 

Components  Associated  with  Part  Two  12 

Process  Areas  13 

Purpose  Statements  13 

Introductory  Notes  14 

Related  Process  Areas  14 

Specific  Goals  14 

Generic  Goals  14 

Specific  Goal  and  Practice  Summaries  1 5 

Specific  Practices  15 

Example  Work  Products  1 5 

Example  Supplier  Deliverables  15 

Subpractices  15 

Generic  Practices  16 

Generic  Practice  Elaborations  16 

Additions  16 

Supporting  Informative  Components  17 

Notes  17 

Examples  17 

References  1 7 

Numbering  Scheme  18 

Typographical  Conventions  18 

3  Tying  It  All  Together  23 

Understanding  Levels  23 

Table  of  Contents  vii 


CMMI  for  Acquisition,  Version  1.3 


Structures  of  the  Continuous  and  Staged  Representations  24 

Understanding  Capability  Levels  26 

Capability  Level  0:  Incomplete  26 

Capability  Level  1 :  Performed  26 

Capability  Level  2:  Managed  27 

Capability  Level  3:  Defined  27 

Advancing  Through  Capability  Levels  27 

Understanding  Maturity  Levels  28 

Maturity  Level  1 :  Initial  29 

Maturity  Level  2:  Managed  29 

Maturity  Level  3:  Defined  30 

Maturity  Level  4:  Quantitatively  Managed  30 

Maturity  Level  5:  Optimizing  31 

Advancing  Through  Maturity  Levels  31 

Process  Areas  33 

Equivalent  Staging  36 

Achieving  High  Maturity  39 

4  Relationships  Among  Process  Areas  41 

Project  Processes  42 

Organizational  Processes  46 

Support  Processes  47 

High  Maturity  Processes  49 

5  Using  CMMI  Models  51 

Adopting  CMMI  51 

Your  Process  Improvement  Program  52 

Selections  that  Influence  Your  Program  52 

CMMI  Models  53 

Using  CMMI  Appraisals  54 

Appraisal  Requirements  for  CMMI  54 

SCAMPI  Appraisal  Methods  55 

Appraisal  Considerations  55 

CMMI  Related  Training  56 

Part  Two:  Generic  Goals  and  Generic  Practices,  and  the  Process  Areas  57 

Generic  Goals  and  Generic  Practices  59 

Overview  59 

Process  Institutionalization  59 

Performed  Process  59 

Managed  Process  60 

Defined  Process  60 

Relationships  Among  Processes  61 

Generic  Goals  and  Generic  Practices  62 

Applying  Generic  Practices  72 

Process  Areas  that  Support  Generic  Practices  72 

Agreement  Management  77 

Acquisition  Requirements  Development  83 

Acquisition  Technical  Management  97 

Acquisition  Validation  109 

Acquisition  Verification  117 


viii 


Table  of  Contents 


CMMI  for  Acquisition,  Version  1.3 


Causal  Analysis  and  Resolution  125 

Configuration  Management  135 

Decision  Analysis  and  Resolution  147 

Integrated  Project  Management  155 

Measurement  and  Analysis  171 

Organizational  Process  Definition  189 

Organizational  Process  Focus  201 

Organizational  Performance  Management  215 

Organizational  Process  Performance  233 

Organizational  Training  247 

Project  Monitoring  and  Control  259 

Project  Planning  273 

Process  and  Product  Quality  Assurance  301 

Quantitative  Project  Management  307 

Requirements  Management  325 

Risk  Management  333 

Solicitation  and  Supplier  Agreement  Development  349 

Part  Three:  The  Appendices  367 

Appendix  A:  References  369 

Information  Assurance/Information  Security  Related  Sources  374 

Appendix  B:  Acronyms  375 

Appendix  C:  CMMI  Version  1.3  Project  Participants  381 

CMMI  Steering  Group  381 

Steering  Group  Members  381 

Ex-Officio  Steering  Group  Members  382 

Steering  Group  Support  382 

CMMI  for  Services  Advisory  Group  382 

CMMI  VI  .3  Coordination  Team  383 

CMMI  VI  .3  Configuration  Control  Board  383 

CMMI  VI  .3  Core  Model  Team  384 

CMMI  VI  .3  Translation  Team  384 

CMMI  VI  .3  High  Maturity  Team  385 

CMMI  VI  .3  Acquisition  Mini  Team  385 

CMMI  VI  .3  Services  Mini  Team  385 

CMMI  VI  .3  SCAMPI  Upgrade  Team  386 

CMMI  Version  1 .3  Training  Teams  386 

ACQ  and  DEV  Training  Team  386 

SVC  Training  Team  387 

CMMI  VI  .3  Quality  Team  387 

Appendix  D:  Glossary  389 


Table  of  Contents 


IX 


CMMI  for  Acquisition,  Version  1.3 


X 


Table  of  Contents 


CMMI  for  Acquisition,  Version  1.3 

Part  One: 

About  CMMI  for  Acquisition 


i 


CMMI  for  Acquisition,  Version  1.3 


2 


CMMI  for  Acquisition,  Version  1.3 


1  Introduction 


Now  more  than  ever,  organizations  are  increasingly  becoming  acquirers5  of 
needed  capabilities  by  obtaining  products  and  services  from  suppliers  and 
developing  less  and  less  of  these  capabilities  in-house.  This  widely  adopted 
business  strategy  is  designed  to  improve  an  organization’s  operational 
efficiencies  by  leveraging  suppliers’  capabilities  to  deliver  quality  solutions 
rapidly,  at  lower  cost,  and  with  the  most  appropriate  technology. 

Acquisition  of  needed  capabilities  is  challenging  because  acquirers  have 
overall  accountability  for  satisfying  the  end  user  while  allowing  the  supplier 
to  perform  the  tasks  necessary  to  develop  and  provide  the  solution. 

Mismanagement,  the  inability  to  articulate  customer  needs,  poor 
requirements  definition,  inadequate  supplier  selection  and  contracting 
processes,  insufficient  technology  selection  procedures,  and  uncontrolled 
requirements  changes  are  factors  that  contribute  to  project  failure. 
Responsibility  is  shared  by  both  the  supplier  and  the  acquirer.  The  majority 
of  project  failures  could  be  avoided  if  the  acquirer  learned  how  to  properly 
prepare  for,  engage  with,  and  manage  suppliers. 

In  addition  to  these  challenges,  an  overall  key  to  a  successful  acquirer- 
supplier  relationship  is  communication. 

Unfortunately,  many  organizations  have  not  invested  in  the  capabilities 
necessary  to  effectively  manage  projects  in  an  acquisition  environment.  Too 
often  acquirers  disengage  from  the  project  once  the  supplier  is  hired.  Too 
late  they  discover  that  the  project  is  not  on  schedule,  deadlines  will  not  be 
met,  the  technology  selected  is  not  viable,  and  the  project  has  failed. 

The  acquirer  has  a  focused  set  of  major  objectives.  These  objectives 
include  the  requirement  to  maintain  a  relationship  with  end  users  to  fully 
comprehend  their  needs.  The  acquirer  owns  the  project,  executes  overall 
project  management,  and  is  accountable  for  delivering  the  product  or 
service  to  the  end  users.  Thus,  these  acquirer  responsibilities  can  extend 
beyond  ensuring  the  product  or  service  is  delivered  by  chosen  suppliers  to 
include  activities  such  as  integrating  the  overall  product  or  service,  ensuring 
it  makes  the  transition  into  operation,  and  obtaining  insight  into  its 
appropriateness  and  adequacy  to  continue  to  meet  customer  needs. 

CMMI®  for  Acquisition  (CMMI-ACQ)  enables  organizations  to  avoid  or 
eliminate  barriers  in  the  acquisition  process  through  practices  and 
terminology  that  transcend  the  interests  of  individual  departments  or 
groups. 


In  CMMI-ACQ,  the  terms  project  and  acquirer  refer  to  the  acquisition  project;  the  term  organization  refers  to  the  acquisition 
organization. 
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CMMI-ACQ  contains  22  process  areas.  Of  those  process  areas,  16  are 
core  process  areas  that  cover  Process  Management,  Project  Management, 
and  Support  process  areas.6 

Six  process  areas  focus  on  practices  specific  to  acquisition,  addressing 
agreement  management,  acquisition  requirements  development,  acquisition 
technical  management,  acquisition  validation,  acquisition  verification,  and 
solicitation  and  supplier  agreement  development. 

All  CMMI-ACQ  model  practices  focus  on  the  activities  of  the  acquirer. 

Those  activities  include  supplier  sourcing;  developing  and  awarding 
supplier  agreements;  and  managing  the  acquisition  of  capabilities,  including 
the  acquisition  of  both  products  and  services.  Supplier  activities  are  not 
addressed  in  this  document.  Suppliers  and  acquirers  who  also  develop 
products  and  services  should  consider  using  the  CMMI-DEV  model. 


About  Process  Improvement 


In  its  research  to  help  organizations  to  develop  and  maintain  quality 
products  and  services,  the  Software  Engineering  Institute  (SEI)  has  found 
several  dimensions  that  an  organization  can  focus  on  to  improve  its 
business.  Figure  1 .1  illustrates  the  three  critical  dimensions  that 
organizations  typically  focus  on:  people,  procedures  and  methods,  and 
tools  and  equipment. 

Procedures  and  methods 
defining  the  relationship  of 
tasks 


B 


Tools  and 
equipment 


What  holds  everything  together?  It  is  the  processes  used  in  your 
organization.  Processes  allow  you  to  align  the  way  you  do  business.  They 
allow  you  to  address  scalability  and  provide  a  way  to  incorporate  knowledge 
of  how  to  do  things  better.  Processes  allow  you  to  leverage  your  resources 
and  to  examine  business  trends. 


A  core  process  area  is  a  process  area  that  is  common  to  all  CMMI  models.  A  shared  process  area  is  shared  by  at  least  two 
CMMI  models,  but  not  all  of  them. 
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This  is  not  to  say  that  people  and  technology  are  not  important.  We  are 
living  in  a  world  where  technology  is  changing  at  an  incredible  speed. 
Similarly,  people  typically  work  for  many  companies  throughout  their 
careers.  We  live  in  a  dynamic  world.  A  focus  on  process  provides  the 
infrastructure  and  stability  necessary  to  deal  with  an  ever-changing  world 
and  to  maximize  the  productivity  of  people  and  the  use  of  technology  to  be 
competitive. 

Manufacturing  has  long  recognized  the  importance  of  process  effectiveness 
and  efficiency.  Today,  many  organizations  in  manufacturing  and  service 
industries  recognize  the  importance  of  quality  processes.  Process  helps  an 
organization’s  workforce  to  meet  business  objectives  by  helping  them  to 
work  smarter,  not  harder,  and  with  improved  consistency.  Effective 
processes  also  provide  a  vehicle  for  introducing  and  using  new  technology 
in  a  way  that  best  meets  the  business  objectives  of  the  organization. 


About  Capability  Maturity  Models 

A  Capability  Maturity  Model®  (CMM®),  including  CMMI,  is  a  simplified 
representation  of  the  world.  CMMs  contain  the  essential  elements  of 
effective  processes.  These  elements  are  based  on  the  concepts  developed 
by  Crosby,  Deming,  Juran,  and  Humphrey. 

In  the  1930s,  Walter  Shewhart  began  work  in  process  improvement  with  his 
principles  of  statistical  quality  control  [Shewhart  1931].  These  principles 
were  refined  by  W.  Edwards  Deming  [Deming  1986],  Phillip  Crosby  [Crosby 
1979],  and  Joseph  Juran  [Juran  1988].  Watts  Humphrey,  Ron  Radice,  and 
others  extended  these  principles  further  and  began  applying  them  to 
software  in  their  work  at  IBM  (International  Business  Machines)  and  the  SEI 
[Humphrey  1989],  Humphrey’s  book,  Managing  the  Software  Process, 
provides  a  description  of  the  basic  principles  and  concepts  on  which  many 
of  the  Capability  Maturity  Models®  (CMMs®)  are  based. 

The  SEI  has  taken  the  process  management  premise,  “the  quality  of  a 
system  or  product  is  highly  influenced  by  the  quality  of  the  process  used  to 
develop  and  maintain  it,”  and  defined  CMMs  that  embody  this  premise.  The 
belief  in  this  premise  is  seen  worldwide  in  quality  movements,  as  evidenced 
by  the  International  Organization  for  Standardization/International 
Electrotechnical  Commission  (ISO/I EC)  body  of  standards. 

CMMs  focus  on  improving  processes  in  an  organization.  They  contain  the 
essential  elements  of  effective  processes  for  one  or  more  disciplines  and 
describe  an  evolutionary  improvement  path  from  ad  hoc,  immature 
processes  to  disciplined,  mature  processes  with  improved  quality  and 
effectiveness. 

Like  other  CMMs,  CMMI  models  provide  guidance  to  use  when  developing 
processes.  CMMI  models  are  not  processes  or  process  descriptions.  The 
actual  processes  used  in  an  organization  depend  on  many  factors, 
including  application  domains  and  organization  structure  and  size.  In 
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particular,  the  process  areas  of  a  CMMI  model  typically  do  not  map  one  to 
one  with  the  processes  used  in  your  organization. 

The  SEI  created  the  first  CMM  designed  for  software  organizations  and 
published  it  in  a  book,  The  Capability  Maturity  Model:  Guidelines  for 
Improving  the  Software  Process  [SEI  1995]. 

Today,  CMMI  is  an  application  of  the  principles  introduced  almost  a  century 
ago  to  this  never-ending  cycle  of  process  improvement.  The  value  of  this 
process  improvement  approach  has  been  confirmed  over  time. 
Organizations  have  experienced  increased  productivity  and  quality, 
improved  cycle  time,  and  more  accurate  and  predictable  schedules  and 
budgets  [Gibson  2006]. 


Evolution  of  CMMI 

The  CMM  Integration®  project  was  formed  to  sort  out  the  problem  of  using 
multiple  CMMs.  The  combination  of  selected  models  into  a  single 
improvement  framework  was  intended  for  use  by  organizations  in  their 
pursuit  of  enterprise-wide  process  improvement. 

Developing  a  set  of  integrated  models  involved  more  than  simply  combining 
existing  model  materials.  Using  processes  that  promote  consensus,  the 
CMMI  Product  Team  built  a  framework  that  accommodates  multiple 
constellations. 

The  first  model  to  be  developed  was  the  CMMI  for  Development  model 
(then  simply  called  “CMMI”).  Figure  1.2  illustrates  the  models  that  led  to 
CMMI  Version  1 .3. 
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History  of  CMMs 


CMM  for  Software 
VI. 1  (1! 


INCOSE  SECAM 

V 

(1996) 

Systems  Engineering 
CMM  VI  .1  (1995) 


Software  CMM 
V2,  draft  C  (1997) 


Software  Acquisition 
CMM  VI  .03  (2002) 


r 


EIA731  SECM 
(1998) 


\i  r 


VI  .02  (2000) 


VI  .1  (2002) 


CMMI  for  Acquisition 
VI  .2  (2007) _ 


CMMI  for  Development 
VI  .2  (2006) 


Integrated  Product 
Development  CMM 
(1997) 


CMMI  for  Services 
VI  .2  (2009) _ 
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CMMI  for  Acquisition 
VI  .3  (2010) 


CMMI  for  Development 
VI  .3  (2010) 


CMMI  for  Services 
VI  .3  (2010) 


Figure  1.2:  The  History  of  CMMs7 

Initially,  CMMI  was  one  model  that  combined  three  source  models:  the 
Capability  Maturity  Model  for  Software  (SW-CMM)  v2.0  draft  C,  the 
Systems  Engineering  Capability  Model  (SECM)  [EIA  2002],  and  the 
Integrated  Product  Development  Capability  Maturity  Model  (IPD-CMM) 
v0.98. 

These  three  source  models  were  selected  because  of  their  successful 
adoption  or  promising  approach  to  improving  processes  in  an  organization. 

The  first  CMMI  model  (VI  .02)  was  designed  for  use  by  development 
organizations  in  their  pursuit  of  enterprise-wide  process  improvement.  It 
was  released  in  2000.  Two  years  later  version  1 .1  was  released  and  four 
years  after  that,  version  1 .2  was  released. 

By  the  time  that  version  1 .2  was  released,  two  other  CMMI  models  were 
being  planned.  Because  of  this  planned  expansion,  the  name  of  the  first 
CMMI  model  had  to  change  to  become  CMMI  for  Development  and  the 
concept  of  constellations  was  created. 

The  CMMI  for  Acquisition  model  was  released  in  2007  [SEI  2007a].  Since  it 
built  on  the  CMMI  for  Development  Version  1 .2  model,  it  also  was  named 


EIA  731  SECM  is  the  Electronic  Industries  Alliance  standard  731 ,  or  the  Systems  Engineering  Capability  Model.  INCOSE 
SECAM  is  International  Council  on  Systems  Engineering  Systems  Engineering  Capability  Assessment  Model  [EIA  2002a], 


Introduction 


7 


CMMI  for  Acquisition,  Version  1.3 


Version  1 .2.  Two  years  later  the  CMMI  for  Services  model  was  released.  It 
built  on  the  other  two  models  and  also  was  named  Version  1 .2. 

In  2008  plans  were  drawn  to  begin  developing  Version  1 .3,  which  would 
ensure  consistency  among  all  three  models  and  improve  high  maturity 
material.  Version  1 .3  of  CMMI  for  Acquisition  [Gallagher  2011],  CMMI  for 
Development  [Chrissis  201 1 ,  SEI  201 0a],  and  CMMI  for  Services  [Forrester 
201 1 ,  SEI  2010b]  were  released  in  November  2010. 


CMMI  Framework 


The  CMMI  Framework  provides  the  structure  needed  to  produce  CMMI 
models,  training,  and  appraisal  components.  To  allow  the  use  of  multiple 
models  within  the  CMMI  Framework,  model  components  are  classified  as 
either  common  to  all  CMMI  models  or  applicable  to  a  specific  model.  The 
common  material  is  called  the  “CMMI  Model  Foundation”  or  “CMF.” 

The  components  of  the  CMF  are  part  of  every  model  generated  from  the 
CMMI  Framework.  Those  components  are  combined  with  material 
applicable  to  an  area  of  interest  (e.g.,  acquisition,  development,  services)  to 
produce  a  model. 

A  “constellation”  is  defined  as  a  collection  of  CMMI  components  that  are 
used  to  construct  models,  training  materials,  and  appraisal  related 
documents  for  an  area  of  interest  (e.g.,  acquisition,  development,  services). 
The  Acquisition  constellation’s  model  is  called  “CMMI  for  Acquisition”  or 
“CMMI-ACQ.” 


CMMI  for  Acquisition 


The  CMMI  Steering  Group  initially  approved  a  small  introductory  collection 
of  acquisition  best  practices  called  the  Acquisition  Module  ( CMMI-AM ), 
which  was  based  on  the  CMMI  Framework.  While  it  described  best 
practices,  it  was  not  intended  to  become  an  appraisable  model  nor  a  model 
suitable  for  process  improvement  purposes.  A  similar,  but  more  up-to-date 
document,  CMMI  for  Acquisition  Primer,  is  now  available  [Richter  2008]. 

General  Motors  partnered  with  the  SEI  to  create  the  initial  Acquisition  model 
draft  that  was  the  basis  for  this  model.  The  model  now  represents  the  work 
of  many  organizations  and  individuals  from  industry,  government,  and  the 
SEI. 

When  using  this  model,  use  professional  judgment  and  common  sense  to 
interpret  it  for  your  organization.  That  is,  although  the  process  areas 
described  in  this  model  depict  behaviors  considered  best  practices  for  most 
acquirers,  all  process  areas  and  practices  should  be  interpreted  using  an  in- 
depth  knowledge  of  CMMI-ACQ,  your  organizational  constraints,  and  your 
business  environment  [SEI  2007b]. 
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This  document  is  a  reference  model  that  covers  the  acquisition  of  needed 
capabilities.  Capabilities  are  acquired  in  many  industries,  including 
aerospace,  banking,  computer  hardware,  software,  defense,  automobile 
manufacturing,  and  telecommunications.  All  of  these  industries  can  use 
CMMI-ACQ. 
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2  Process  Area  Components 


This  chapter  describes  the  components  found  in  each  process  area  and  in 
the  generic  goals  and  generic  practices.  Understanding  these  components 
is  critical  to  using  the  information  in  Part  Two  effectively.  If  you  are 
unfamiliar  with  Part  Two,  you  may  want  to  skim  the  Generic  Goals  and 
Generic  Practices  section  and  a  couple  of  process  area  sections  to  get  a 
general  feel  for  the  content  and  layout  before  reading  this  chapter. 


Core  Process  Areas  and  CMMI  Models 


All  CMMI  models  are  produced  from  the  CMMI  Framework.  This  framework 
contains  all  of  the  goals  and  practices  that  are  used  to  produce  CMMI 
models  that  belong  to  CMMI  constellations. 

All  CMMI  models  contain  16  core  process  areas.  These  process  areas 
cover  basic  concepts  that  are  fundamental  to  process  improvement  in  any 
area  of  interest  (i.e.,  acquisition,  development,  services).  Some  of  the 
material  in  the  core  process  areas  is  the  same  in  all  constellations.  Other 
material  may  be  adjusted  to  address  a  specific  area  of  interest. 
Consequently,  the  material  in  the  core  process  areas  may  not  be  exactly 
the  same. 


Required,  Expected,  and  Informative  Components 


Model  components  are  grouped  into  three  categories — required,  expected, 
and  informative — that  reflect  how  to  interpret  them. 

Required  Components _ 

Required  components  are  CMMI  components  that  are  essential  to 
achieving  process  improvement  in  a  given  process  area.  This  achievement 
must  be  visibly  implemented  in  an  organization’s  processes.  The  required 
components  in  CMMI  are  the  specific  and  generic  goals.  Goal  satisfaction  is 
used  in  appraisals  as  the  basis  for  deciding  whether  a  process  area  has 
been  satisfied. 

Expected  Components _ 

Expected  components  are  CMMI  components  that  describe  the  activities 
that  are  important  in  achieving  a  required  CMMI  component.  Expected 
components  guide  those  who  implement  improvements  or  perform 
appraisals.  The  expected  components  in  CMMI  are  the  specific  and  generic 
practices. 
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Before  goals  can  be  considered  to  be  satisfied,  either  their  practices  as 
described,  or  acceptable  alternatives  to  them,  must  be  present  in  the 
planned  and  implemented  processes  of  the  organization. 

Informative  Components 

Informative  components  are  CMMI  components  that  help  model  users 
understand  CMMI  required  and  expected  components.  These  components 
can  be  example  boxes,  detailed  explanations,  or  other  helpful  information. 
Subpractices,  notes,  references,  goal  titles,  practice  titles,  sources, 
example  work  products,  and  generic  practice  elaborations  are  informative 
model  components. 

The  informative  material  plays  an  important  role  in  understanding  the 
model.  It  is  often  impossible  to  adequately  describe  the  behavior  required  or 
expected  of  an  organization  using  only  a  single  goal  or  practice  statement. 
The  model’s  informative  material  provides  information  necessary  to  achieve 
the  correct  understanding  of  goals  and  practices  and  thus  cannot  be 
ignored. 

For  CMMI-ACQ,  example  supplier  deliverables  are  added  informative 
components  that  are  not  found  in  other  CMMI  models.  These  components 
are  included  in  this  model  because  of  the  interaction  between  supplier  and 
acquirer  processes. 


Components  Associated  with  Part  Two 


The  model  components  associated  with  Part  Two  are  summarized  in  Figure 
2.1  to  illustrate  their  relationships. 


KEY: 


Figure  2.1:  CMMI  Model  Components 
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The  following  sections  provide  detailed  descriptions  of  CMMI  model 
components. 

Process  Areas _ 

A  process  area  is  a  cluster  of  related  practices  in  an  area  that,  when 
implemented  collectively,  satisfies  a  set  of  goals  considered  important  for 
making  improvement  in  that  area.  (See  the  definition  of  “process  area”  in 
the  glossary.) 

The  22  process  areas  are  presented  in  alphabetical  order  by  acronym: 

•  Agreement  Management  (AM) 

•  Acquisition  Requirements  Development  (ARD) 

•  Acquisition  Technical  Management  (ATM) 

•  Acquisition  Validation  (AVAL) 

•  Acquisition  Verification  (AVER) 

•  Causal  Analysis  and  Resolution  (CAR) 

•  Configuration  Management  (CM) 

•  Decision  Analysis  and  Resolution  (DAR) 

•  Integrated  Project  Management  (IPM) 

•  Measurement  and  Analysis  (MA) 

•  Organizational  Process  Definition  (OPD) 

•  Organizational  Process  Focus  (OPF) 

•  Organizational  Performance  Management  (OPM) 

•  Organizational  Process  Performance  (OPP) 

•  Organizational  Training  (OT) 

•  Project  Monitoring  and  Control  (PMC) 

•  Project  Planning  (PP) 

•  Process  and  Product  Quality  Assurance  (PPQA) 

•  Quantitative  Project  Management  (QPM) 

•  Requirements  Management  (REQM) 

•  Risk  Management  (RSKM) 

•  Solicitation  and  Supplier  Agreement  Development  (SSAD) 

Purpose  Statements _ 

A  purpose  statement  describes  the  purpose  of  the  process  area  and  is  an 
informative  component. 

For  example,  the  purpose  statement  of  the  Organizational  Process 
Definition  process  area  is  “The  purpose  of  Organizational  Process 
Definition  (OPD)  is  to  establish  and  maintain  a  usable  set  of  organizational 
process  assets,  work  environment  standards,  and  rules  and  guidelines  for 
teams.” 
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Introductory  Notes _ 

The  introductory  notes  section  of  the  process  area  describes  the  major 
concepts  covered  in  the  process  area  and  is  an  informative  component. 

An  example  from  the  introductory  notes  of  the  Project  Monitoring  and 
Control  process  area  is  “When  actual  status  deviates  significantly  from 
expected  values,  corrective  actions  are  taken  as  appropriate.” 

Related  Process  Areas _ 

The  Related  Process  Areas  section  lists  references  to  related  process 
areas  and  reflects  the  high-level  relationships  among  the  process  areas. 

The  Related  Process  Areas  section  is  an  informative  component. 

An  example  of  a  reference  found  in  the  Related  Process  Areas  section  of 
the  Project  Planning  process  area  is  “Refer  to  the  Risk  Management 
process  area  for  more  information  about  identifying  and  analyzing  risks  and 
mitigating  risks.” 

Specific  Goals _ 

A  specific  goal  describes  the  unique  characteristics  that  must  be  present  to 
satisfy  the  process  area.  A  specific  goal  is  a  required  model  component  and 
is  used  in  appraisals  to  help  determine  whether  a  process  area  is  satisfied. 
(See  the  definition  of  “specific  goal”  in  the  glossary.) 

For  example,  a  specific  goal  from  the  Configuration  Management  process 
area  is  “Integrity  of  baselines  is  established  and  maintained.” 

Only  the  statement  of  the  specific  goal  is  a  required  model  component.  The 
title  of  a  specific  goal  (preceded  by  the  goal  number)  and  notes  associated 
with  the  goal  are  considered  informative  model  components. 

Generic  Goals _ 

Generic  goals  are  called  “generic”  because  the  same  goal  statement 
applies  to  multiple  process  areas.  A  generic  goal  describes  the 
characteristics  that  must  be  present  to  institutionalize  processes  that 
implement  a  process  area.  A  generic  goal  is  a  required  model  component 
and  is  used  in  appraisals  to  determine  whether  a  process  area  is  satisfied. 
(See  the  Generic  Goals  and  Generic  Practices  section  in  Part  Two  for  a 
more  detailed  description  of  generic  goals.  See  the  definition  of  “generic 
goal”  in  the  glossary.) 

An  example  of  a  generic  goal  is  “The  process  is  institutionalized  as  a 
defined  process.” 

Only  the  statement  of  the  generic  goal  is  a  required  model  component.  The 
title  of  a  generic  goal  (preceded  by  the  goal  number)  and  notes  associated 
with  the  goal  are  considered  informative  model  components. 
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Specific  Goal  and  Practice  Summaries 

The  specific  goal  and  practice  summary  provides  a  high-level  summary  of 
the  specific  goals  and  specific  practices.  The  specific  goal  and  practice 
summary  is  an  informative  component. 

Specific  Practices _ 

A  specific  practice  is  the  description  of  an  activity  that  is  considered 
important  in  achieving  the  associated  specific  goal.  The  specific  practices 
describe  the  activities  that  are  expected  to  result  in  achievement  of  the 
specific  goals  of  a  process  area.  A  specific  practice  is  an  expected  model 
component.  (See  the  definition  of  “specific  practice”  in  the  glossary.) 

For  example,  a  specific  practice  from  the  Project  Monitoring  and  Control 
process  area  is  “Monitor  commitments  against  those  identified  in  the  project 
plan.” 

Only  the  statement  of  the  specific  practice  is  an  expected  model 
component.  The  title  of  a  specific  practice  (preceded  by  the  practice 
number)  and  notes  associated  with  the  specific  practice  are  considered 
informative  model  components. 

Example  Work  Products 

The  example  work  products  section  lists  sample  outputs  from  a  specific 
practice.  An  example  work  product  is  an  informative  model  component. 

(See  the  definition  of  “example  work  product”  in  the  glossary.) 

For  instance,  an  example  work  product  for  the  specific  practice  “Monitor 
Project  Planning  Parameters”  in  the  Project  Monitoring  and  Control  process 
area  is  “Records  of  significant  deviations.” 

Example  Supplier  Deliverables 

To  aid  the  acquirer,  example  supplier  deliverables  are  also  provided.  An 
example  supplier  deliverable  represents  an  artifact  that  is  input  into  or 
supports  the  acquirer’s  implementation  of  the  practice.  An  example  supplier 
deliverable  is  an  informative  model  component. 

For  instance,  an  example  supplier  deliverable  for  the  specific  practice 
“Perform  activities  with  the  supplier  as  specified  in  the  supplier  agreement” 
in  the  Agreement  Management  process  area  is  “Supplier  project  progress 
and  performance  reports.” 

Subpractices _ 

A  subpractice  is  a  detailed  description  that  provides  guidance  for 
interpreting  and  implementing  a  specific  or  generic  practice.  Subpractices 
can  be  worded  as  if  prescriptive,  but  they  are  actually  an  informative 
component  meant  only  to  provide  ideas  that  may  be  useful  for  process 
improvement.  (See  the  definition  of  “subpractice”  in  the  glossary.) 


Process  Area  Components 


15 


CMMI  for  Acquisition,  Version  1.3 


For  example,  a  subpractice  for  the  specific  practice  “Take  Corrective 
Action”  in  the  Project  Monitoring  and  Control  process  area  is  “Determine 
and  document  the  appropriate  actions  needed  to  address  identified  issues.” 

Generic  Practices _ 

Generic  practices  are  called  “generic”  because  the  same  practice  applies  to 
multiple  process  areas.  The  generic  practices  associated  with  a  generic 
goal  describe  the  activities  that  are  considered  important  in  achieving  the 
generic  goal  and  contribute  to  the  institutionalization  of  the  processes 
associated  with  a  process  area.  A  generic  practice  is  an  expected  model 
component.  (See  the  definition  of  “generic  practice”  in  the  glossary.) 

For  example,  a  generic  practice  for  the  generic  goal  “The  process  is 
institutionalized  as  a  managed  process”  is  “Provide  adequate  resources  for 
performing  the  process,  developing  the  work  products,  and  providing  the 
services  of  the  process.” 

Only  the  statement  of  the  generic  practice  is  an  expected  model 
component.  The  title  of  a  generic  practice  (preceded  by  the  practice 
number)  and  notes  associated  with  the  practice  are  considered  informative 
model  components. 

Generic  Practice  Elaborations 

Generic  practice  elaborations  appear  after  generic  practices  to  provide 
guidance  on  how  the  generic  practices  can  be  applied  uniquely  to  process 
areas.  A  generic  practice  elaboration  is  an  informative  model  component. 
(See  the  definition  of  “generic  practice  elaboration”  in  the  glossary.) 

For  example,  a  generic  practice  elaboration  after  the  generic  practice 
“Establish  and  maintain  an  organizational  policy  for  planning  and 
performing  the  process”  is  “This  policy  establishes  organizational 
expectations  for  planning  and  performing  the  process,  including  not  only  the 
elements  of  the  process  addressed  directly  by  the  acquirer  but  also  the 
interactions  between  the  acquirer  with  suppliers.” 

Additions 

Additions  are  clearly  marked  model  components  that  contain  information  of 
interest  to  particular  users.  An  addition  can  be  informative  material,  a 
specific  practice,  a  specific  goal,  or  an  entire  process  area  that  extends  the 
scope  of  a  model  or  emphasizes  a  particular  aspect  of  its  use.  There  are  no 
additions  in  the  CMMI-ACQ  model. 
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Supporting  Informative  Components 


In  many  places  in  the  model,  further  information  is  needed  to  describe  a 
concept.  This  informative  material  is  provided  in  the  form  of  the  following 
components: 

•  Notes 

•  Examples 

•  References 

Notes _ 

A  note  is  text  that  can  accompany  nearly  any  other  model  component.  It 
may  provide  detail,  background,  or  rationale.  A  note  is  an  informative  model 
component. 

For  example,  a  note  that  accompanies  the  specific  practice  “Implement 
Action  Proposals”  in  the  Causal  Analysis  and  Resolution  process  area  is 
“Only  changes  that  prove  to  be  of  value  should  be  considered  for  broad 
implementation.” 

Examples 

An  example  is  a  component  comprising  text  and  often  a  list  of  items,  usually 
in  a  box,  that  can  accompany  nearly  any  other  component  and  provides 
one  or  more  examples  to  clarify  a  concept  or  described  activity.  An  example 
is  an  informative  model  component. 

The  following  is  an  example  that  accompanies  the  subpractice  “Document 
noncompliance  issues  when  they  cannot  be  resolved  in  the  project”  under 
the  specific  practice  “Communicate  and  Resolve  Noncompliance  Issues”  in 
the  Process  and  Product  Quality  Assurance  process  area. 

:  Examples  of  ways  to  resolve  noncompliance  in  the  project  include  the  following: 

i  •  Fixing  the  noncompliance 

:  •  Changing  the  process  descriptions,  standards,  or  procedures  that  were  violated 
:  •  Obtaining  a  waiver  to  cover  the  noncompliance 


References 

A  reference  is  a  pointer  to  additional  or  more  detailed  information  in  related 
process  areas  and  can  accompany  nearly  any  other  model  component.  A 
reference  is  an  informative  model  component.  (See  the  definition  of 
“reference”  in  the  glossary.) 

For  example,  a  reference  that  accompanies  the  specific  practice  “Compose 
the  Defined  Process”  in  the  Quantitative  Project  Management  process  area 
is  “Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets.” 
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Numbering  Scheme 


Specific  and  generic  goals  are  numbered  sequentially.  Each  specific  goal 
begins  with  the  prefix  “SG”  (e.g.,  SG  1).  Each  generic  goal  begins  with  the 
prefix  “GG”  (e.g.,  GG  2). 

Specific  and  generic  practices  are  also  numbered  sequentially.  Each 
specific  practice  begins  with  the  prefix  “SP,”  followed  by  a  number  in  the 
form  “x.y”  (e.g.,  SP  1.1).  The  x  is  the  same  number  as  the  goal  to  which  the 
specific  practice  maps.  The  y  is  the  sequence  number  of  the  specific 
practice  under  the  specific  goal. 

An  example  of  specific  practice  numbering  is  in  the  Project  Planning 
process  area.  The  first  specific  practice  is  numbered  SP  1 .1  and  the  second 
is  SP  1.2. 

Each  generic  practice  begins  with  the  prefix  “GP,”  followed  by  a  number  in 
the  form  “x.y”  (e.g.,  GP  1.1). 

The  x  corresponds  to  the  number  of  the  generic  goal.  The  y  is  the  sequence 
number  of  the  generic  practice  under  the  generic  goal.  For  example,  the 
first  generic  practice  associated  with  GG  2  is  numbered  GP  2.1  and  the 
second  is  GP  2.2. 


Typographical  Conventions 


The  typographical  conventions  used  in  this  model  were  designed  to  enable 
you  to  easily  identify  and  select  model  components  by  presenting  them  in 
formats  that  allow  you  to  find  them  quickly  on  the  page. 

Figures  2.2,  2.3,  and  2.4  are  sample  pages  from  process  areas  in  Part  Two; 
they  show  the  different  process  area  components,  labeled  so  that  you  can 
identify  them.  Notice  that  components  differ  typographically  so  that  you  can 
easily  identify  each  one. 
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Process  Area  Name 


DECISION  ANALYSIS  AND  RESOLUTION 


A  Sypport  Process  Area  at  Maturity  Level  3  ^ _ 

Process  Area  Category 


Purpose 


Maturity  Level 


Introductory  Notes 


The  purpose  of  Decision  Analysis  and  Resolution  (DAR)  is  to  analyze 
possible  decisions  using  a  formal  evaluation  process  that  evaluates 
identified  alternatives  against  established  criteria. 


Purpose  Statement 


Introductory  Notes 


The  Decision  Analysis  and  Resolution  process  area  involves  establishing 
guidelines  to  determine  which  issues  should  be  subject  to  a  formal 
evaluation  process  and  applying  formal  evaluation  processes  to  these 
issues. 

A  formal  evaluation  process  is  a  structured  approach  to  evaluating 
alternative  solutions  against  established  critena  to  determine  a 
recommended  solution. 

A  formal  evaluation  process  involves  the  following  actions: 

•  Establishing  the  criteria  for  evaluating  alternatives 

•  Identifying  alternative  solutions 

•  Selecting  methods  for  evaluating  alternatives 

•  Evaluating  alternative  solutions  using  established  criteria  and  methods 

•  Selecting  recommended  solutions  from  alternatives  based  on 
evaluation  criteria 

Ratherthan  using  the  phrase  ‘alternative  solutions  to  address  issues'  each 
time,  in  this  process  area,  one  of  two  shorter  phrases  are  used:  ‘alternative 
solutions'  or  ‘alternatives.' 

A  repeatable  criteria  based  decision-making  process  is  especially 
important,  both  for  making  critical  decisions  that  define  and  guide  the 
acquisition  process  and  later  for  critical  decisions  made  with  the  selected 
supplier.  The  establishment  of  a  formal  process  for  decision  making 
provides  the  acquirerwith  documentation  of  decision  rationale.  Such 
documentation  allows  criteria  for  critical  decisions  to  be  revisited  when 
changes  or  technology  insertion  decisions  that  affect  requirements  or  other 
critical  project  parameters  are  considered  A  formal  process  also  supports 
the  communication  of  decisions  between  the  acquirer  and  supplier. 

A  formal  evaluation  process  reduces  the  subjective  nature  of  a  decision  and 
provides  a  higher  probability  of  selecting  a  solution  that  meets  multiple 
demands  of  relevant  stakeholders. 

While  the  primary  application  of  this  process  area  is  to  technical  concerns, 
formal  evaluation  processes  can  be  applied  to  many  nontechnical  issues, 
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Specific  Goal  and  Practice  Summary 

SG  i  Sau*,  suoflier  Agrearems 

SP  1.1  Execute  Tte  Supaier  Agreererr. 

SP  12  Momor  Sefeoea  Suxiier 

SP  1-3  Accept  Tte  Acqured  =rodxt 
SP  1.1  Manage  Suodier  rua cee 


Specific  Practices  by  Goal 


Specific  Goal 


SG  1  Satisfy  Supplier  Agreements 

The  terms  of  the  supplier  agreement  are  met  by  both  the  acquirer  and  the 
supplier. 


SP1.1 


Specific  Practice 


Execute  the  Supplier  Agreement _ 

Perform  activities  with  the  supplier  as  specified  in  the  supplier 
agreement 

This  specific  practice  covers  internal  and  external  communication  as  well  as 
the  use  of  information  by  the  acquirer  and  supplier  regarding  the 
relationship,  performance,  results,  and  impact  tothe  business.  The  acquirer 
manages  the  relationship  with  the  supplier  to  maintain  effective 
communication  on  key  issues  (e  g.,  changes  in  the  acquirer's  business), 
new  supplier  products  and  technologies,  and  changes  in  the  organizational 
structure. 

Referto  the  Project  Monitoring  and  Control  process  area  for  more  ^ 

information  about  monitoring  the  project  against  the  plan  and  taking 
corrective  action. 


Reference 


Example  Work  Product 


Example  Work  Products 

1.  Integrated  list  of  issues 

2.  Acquisition  project  progress  and  performance  reports 

3.  Supplier  review  materials  and  reports 

4.  Action  items  tracked  to  closure 

5.  Records  of  product  and  document  deliveries 


Subpractice 


-> 


Example  Supplier  Deliverables 


1. 

2. 

3. 


Supplier  project  progress  and  performance  reports 


Corrective  action  results  for  supplier  issues 
Correspondence  with  the  acquirer 


Example  Supplier  Deliverable 


Subpractices 

1.  Monitor  supplier  project  progress  and  performance  (e  g  ,  schedule, 
effort,  cost)  as  defined  in  the  supplier  agreement 


2.  Conduct  management  reviews  with  the  supplier  as  specified  in  the 
supplier  agreement 


Reviews  cover  both  formal  and  informal  reviews  and  include  the  following  steps: 
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cum  for  Aoouwneo  voruoa  '  1 


GG  2 


Institutionalize  a  Managed  Process 


The  process  is  institutionalized  as  a  managed  process. 


GP  2.1 


Establish  an  Organizational  Policy 


Generic  Goal 


Generic  Practice 


Establish  and  maintain  an  organizational  policy  for  planning  and 
performing  the  process. 

The  purpose  of  this  generic  practice  is  to  define  the  organizational 
expectations  forthe  process  and  make  these  expectations  visible  to  those 
members  ofthe  organization  who  are  affected.  In  general,  senior 
management  is  responsible  for  establishing  and  communicating  guiding 
principles,  direction,  and  expectations  forthe  organization. 


Not  all  direction  from  senior  management  will  bear  the  label  ‘policy.’’ The 
existence  of  appropriate  organizational  direction  is  the  expectation  of  this 
generic  practice,  regardless  of  what  it  is  called  or  how  it  is  imparted. 


Elatxoration  for  all  PAs 


Elaboration 

This  policy  establishes  organizational  expectations  for  planning  and 
performing  the  process,  including  not  only  the  elements  ofthe  process 
addressed  directly  by  the  acquirer  but  also  the  interactions  between  the 
acquirer  and  suppliers 


GP  2.2  Plan  the  Process _ 

Establish  and  maintain  the  plan  for  performing  the  process. 

The  purpose  of  this  generic  practice  is  to  determine  what  is  needed  to 
perform  the  process  and  to  achieve  the  established  objectives,  to  prepare  a 
plan  for  performing  the  process,  to  prepare  a  process  description,  and  to 
get  agreement  on  the  plan  from  relevant  stakeholders 

The  practical  implications  of  applying  a  generic  practice  vary  for  each 
process  area. 

!  For  example,  the  planning  described  by  this  generic  practice  as  applied  to  the  Project 
!  Monitoring  and  Control  process  area  can  be  carried  out  in  full  by  the  processes  associated 
!  with  the  Project  Planning  process  area.  However,  thisgenericpractice,  when  applied  to  the 
!  Project  Planning  process  area,  sets  an  expectation  that  the  project  planning  process  itself 
!  be  planned. 


Therefore,  this  generic  practice  can  either  reinforce  expectations  set 
elsewhere  in  CMMI  or  set  new  expectations  that  should  be  addressed. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
establishing  and  maintaining  plans  that  define  project  activities. 

Establishing  a  plan  includes  documenting  the  plan  and  a  process 
description.  Maintaining  the  plan  includes  updating  it  to  reflect  corrective 
actions  or  changes  in  requirements  or  objectives. 
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3  Tying  It  All  Together 


Now  that  you  have  been  introduced  to  the  components  of  CMMI  models, 
you  need  to  understand  how  they  fit  together  to  meet  your  process 
improvement  needs.  This  chapter  introduces  the  concept  of  levels  and 
shows  how  the  process  areas  are  organized  and  used. 

CMMI-ACQ  does  not  specify  that  a  project  or  organization  must  follow  a 
particular  acquisition  process  flow  or  that  a  certain  number  of  deliverables 
per  day  or  specific  project  performance  targets  be  achieved.  The  model 
does  specify  that  a  project  or  organization  should  have  processes  that 
address  acquisition  related  practices.  To  determine  whether  these 
processes  are  in  place,  a  project  or  organization  maps  its  processes  to  the 
process  areas  in  this  model. 

The  mapping  of  processes  to  process  areas  enables  the  organization  to 
track  its  progress  against  the  CMMI-ACQ  model  as  it  updates  or  creates 
processes.  Do  not  expect  that  every  CMMI-ACQ  process  area  will  map  one 
to  one  with  your  organization’s  or  project’s  processes. 


Understanding  Levels 


Levels  are  used  in  CMMI-ACQ  to  describe  an  evolutionary  path 
recommended  for  an  organization  that  wants  to  improve  the  processes  it 
uses  to  acquire  capabilities,  including  products  and  services.  Levels  can 
also  be  the  outcome  of  the  rating  activity  in  appraisals.8  Appraisals  can 
apply  to  entire  organizations  or  to  smaller  groups  such  as  a  group  of 
projects  or  a  division. 

CMMI  supports  two  improvement  paths  using  levels.  One  path  enables 
organizations  to  incrementally  improve  processes  corresponding  to  an 
individual  process  area  (or  group  of  process  areas)  selected  by  the 
organization.  The  other  path  enables  organizations  to  improve  a  set  of 
related  processes  by  incrementally  addressing  successive  sets  of  process 
areas. 

These  two  improvement  paths  are  associated  with  the  two  types  of  levels: 
capability  levels  and  maturity  levels.  These  levels  correspond  to  two 
approaches  to  process  improvement  called  “representations.”  The  two 
representations  are  called  “continuous”  and  “staged.”  Using  the  continuous 
representation  enables  you  to  achieve  “capability  levels.”  Using  the  staged 
representation  enables  you  to  achieve  “maturity  levels.” 


For  more  information  about  appraisals,  refer  to  Appraisal  Requirements  for  CMMI  and  the  Standard  CMMI  Appraisal  Method 
for  Process  Improvement  Method  Definition  Document  [SEI  201 1  a,  SEI  201 1  b]. 
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To  reach  a  particular  level,  an  organization  must  satisfy  all  of  the  goals  of 
the  process  area  or  set  of  process  areas  that  are  targeted  for  improvement, 
regardless  of  whether  it  is  a  capability  or  a  maturity  level. 

Both  representations  provide  ways  to  improve  your  processes  to  achieve 
business  objectives,  and  both  provide  the  same  essential  content  and  use 
the  same  model  components. 


Structures  of  the  Continuous  and  Staged  Representations 


Figure  3.1  illustrates  the  structures  of  the  continuous  and  staged 
representations.  The  differences  between  the  structures  are  subtle  but 
significant.  The  staged  representation  uses  maturity  levels  to  characterize 
the  overall  state  of  the  organization’s  processes  relative  to  the  model  as  a 
whole,  whereas  the  continuous  representation  uses  capability  levels  to 
characterize  the  state  of  the  organization’s  processes  relative  to  an 
individual  process  area. 

Continuous  Representation 


Process  Areas 


Staged  Representation 


Figure  3.1:  Structure  of  the  Continuous  and  Staged  Representations 
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What  may  strike  you  as  you  compare  these  two  representations  is  their 
similarity.  Both  have  many  of  the  same  components  (e.g.,  process  areas, 
specific  goals,  specific  practices),  and  these  components  have  the  same 
hierarchy  and  configuration. 

What  is  not  readily  apparent  from  the  high-level  view  in  Figure  3.1  is  that 
the  continuous  representation  focuses  on  process  area  capability  as 
measured  by  capability  levels  and  the  staged  representation  focuses  on 
overall  maturity  as  measured  by  maturity  levels.  This  dimension  (the 
capability/maturity  dimension)  of  CMMI  is  used  for  benchmarking  and 
appraisal  activities,  as  well  as  guiding  an  organization’s  improvement 
efforts. 

Capability  levels  apply  to  an  organization’s  process  improvement 
achievement  in  individual  process  areas.  These  levels  are  a  means  for 
incrementally  improving  the  processes  corresponding  to  a  given  process 
area.  The  four  capability  levels  are  numbered  0  through  3. 

Maturity  levels  apply  to  an  organization’s  process  improvement 
achievement  across  multiple  process  areas.  These  levels  are  a  means  of 
improving  the  processes  corresponding  to  a  given  set  of  process  areas  (i.e., 
maturity  level).  The  five  maturity  levels  are  numbered  1  through  5. 

Table  3.1  compares  the  four  capability  levels  to  the  five  maturity  levels. 
Notice  that  the  names  of  two  of  the  levels  are  the  same  in  both 
representations  (i.e.,  Managed  and  Defined).  The  differences  are  that  there 
is  no  maturity  level  0;  there  are  no  capability  levels  4  and  5;  and  at  level  1 , 
the  names  used  for  capability  level  1  and  maturity  level  1  are  different. 


Table  3. 1  Comparison  of  Capability  and  Maturity  Levels 


Level 

Continuous  Representation 
Capability  Levels 

Staged  Representation 

Maturity  Levels 

Level  0 

Incomplete 

Level  1 

Performed 

Initial 

Level  2 

Managed 

Managed 

Level  3 

Defined 

Defined 

Level  4 

Quantitatively  Managed 

Level  5 

Optimizing 

The  continuous  representation  is  concerned  with  selecting  both  a  particular 
process  area  to  improve  and  the  desired  capability  level  for  that  process 
area.  In  this  context,  whether  a  process  is  performed  or  incomplete  is 
important.  Therefore,  the  name  “Incomplete”  is  given  to  the  continuous 
representation  starting  point. 
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The  staged  representation  is  concerned  with  selecting  multiple  process 
areas  to  improve  within  a  maturity  level;  whether  individual  processes  are 
performed  or  incomplete  is  not  the  primary  focus.  Therefore,  the  name 
“Initial”  is  given  to  the  staged  representation  starting  point. 

Both  capability  levels  and  maturity  levels  provide  a  way  to  improve  the 
processes  of  an  organization  and  measure  how  well  organizations  can  and 
do  improve  their  processes.  However,  the  associated  approach  to  process 
improvement  is  different. 


Understanding  Capability  Levels 


To  support  those  who  use  the  continuous  representation,  all  CMMI  models 
reflect  capability  levels  in  their  design  and  content. 

The  four  capability  levels,  each  a  layer  in  the  foundation  for  ongoing 
process  improvement,  are  designated  by  the  numbers  0  through  3: 

0.  Incomplete 

1 .  Performed 

2.  Managed 

3.  Defined 

A  capability  level  for  a  process  area  is  achieved  when  all  of  the  generic 
goals  are  satisfied  up  to  that  level.  The  fact  that  capability  levels  2  and  3 
use  the  same  terms  as  generic  goals  2  and  3  is  intentional  because  each  of 
these  generic  goals  and  practices  reflects  the  meaning  of  the  capability 
levels  of  the  goals  and  practices.  (See  the  Generic  Goals  and  Generic 
Practices  section  in  Part  Two  for  more  information  about  generic  goals  and 
practices.)  A  short  description  of  each  capability  level  follows. 

Capability  Level  0:  Incomplete _ 

An  incomplete  process  is  a  process  that  either  is  not  performed  or  is 
partially  performed.  One  or  more  of  the  specific  goals  of  the  process  area 
are  not  satisfied  and  no  generic  goals  exist  for  this  level  since  there  is  no 
reason  to  institutionalize  a  partially  performed  process. 

Capability  Level  1 :  Performed 

A  capability  level  1  process  is  characterized  as  a  performed  process.  A 
performed  process  is  a  process  that  accomplishes  the  needed  work  to 
produce  work  products;  the  specific  goals  of  the  process  area  are  satisfied. 

Although  capability  level  1  results  in  important  improvements,  those 
improvements  can  be  lost  over  time  if  they  are  not  institutionalized.  The 
application  of  institutionalization  (the  CMMI  generic  practices  at  capability 
levels  2  and  3)  helps  to  ensure  that  improvements  are  maintained. 
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Capability  Level  2:  Managed _ 

A  capability  level  2  process  is  characterized  as  a  managed  process.  A 
managed  process  is  a  performed  process  that  is  planned  and  executed  in 
accordance  with  policy;  employs  skilled  people  having  adequate  resources 
to  produce  controlled  outputs;  involves  relevant  stakeholders;  is  monitored, 
controlled,  and  reviewed;  and  is  evaluated  for  adherence  to  its  process 
description. 

The  process  discipline  reflected  by  capability  level  2  helps  to  ensure  that 
existing  practices  are  retained  during  times  of  stress. 

Capability  Level  3:  Defined _ 

A  capability  level  3  process  is  characterized  as  a  defined  process.  A 
defined  process  is  a  managed  process  that  is  tailored  from  the 
organization’s  set  of  standard  processes  according  to  the  organization’s 
tailoring  guidelines;  has  a  maintained  process  description;  and  contributes 
process  related  experiences  to  the  organizational  process  assets. 

A  critical  distinction  between  capability  levels  2  and  3  is  the  scope  of 
standards,  process  descriptions,  and  procedures.  At  capability  level  2,  the 
standards,  process  descriptions,  and  procedures  can  be  quite  different  in 
each  specific  instance  of  the  process  (e.g.,  on  a  particular  project).  At 
capability  level  3,  the  standards,  process  descriptions,  and  procedures  for  a 
project  are  tailored  from  the  organization’s  set  of  standard  processes  to  suit 
a  particular  project  or  organizational  unit  and  therefore  are  more  consistent, 
except  for  the  differences  allowed  by  the  tailoring  guidelines. 

Another  critical  distinction  is  that  at  capability  level  3  processes  are  typically 
described  more  rigorously  than  at  capability  level  2.  A  defined  process 
clearly  states  the  purpose,  inputs,  entry  criteria,  activities,  roles,  measures, 
verification  steps,  outputs,  and  exit  criteria.  At  capability  level  3,  processes 
are  managed  more  proactively  using  an  understanding  of  the 
interrelationships  of  the  process  activities  and  detailed  measures  of  the 
process  and  its  work  products. 

Advancing  Through  Capability  Levels 

The  capability  levels  of  a  process  area  are  achieved  through  the  application 
of  generic  practices  or  suitable  alternatives  to  the  processes  associated 
with  that  process  area. 

Reaching  capability  level  1  for  a  process  area  is  equivalent  to  saying  that 
the  processes  associated  with  that  process  area  are  performed  processes. 

Reaching  capability  level  2  for  a  process  area  is  equivalent  to  saying  that 
there  is  a  policy  that  indicates  you  will  perform  the  process.  There  is  a  plan 
for  performing  it,  resources  are  provided,  responsibilities  are  assigned, 
training  to  perform  it  is  provided,  selected  work  products  related  to 
performing  the  process  are  controlled,  and  so  on.  In  other  words,  a 
capability  level  2  process  can  be  planned  and  monitored  just  like  any 
project  or  support  activity. 
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Reaching  capability  level  3  for  a  process  area  is  equivalent  to  saying  that 
an  organizational  standard  process  exists  associated  with  that  process 
area,  which  can  be  tailored  to  the  needs  of  the  project.  The  processes  in 
the  organization  are  now  more  consistently  defined  and  applied  because 
they  are  based  on  organizational  standard  processes. 

After  an  organization  has  reached  capability  level  3  in  the  process  areas  it 
has  selected  for  improvement,  it  can  continue  its  improvement  journey  by 
addressing  high  maturity  process  areas  (Organizational  Process 
Performance,  Quantitative  Project  Management,  Causal  Analysis  and 
Resolution,  and  Organizational  Performance  Management). 

The  high  maturity  process  areas  focus  on  improving  the  performance  of 
those  processes  already  implemented.  The  high  maturity  process  areas 
describe  the  use  of  statistical  and  other  quantitative  techniques  to  improve 
organizational  and  project  processes  to  better  achieve  business  objectives. 

When  continuing  its  improvement  journey  in  this  way,  an  organization  can 
derive  the  most  benefit  by  first  selecting  the  OPP  and  QPM  process  areas, 
and  bringing  those  process  areas  to  capability  levels  1 , 2,  and  3.  In  doing 
so,  projects  and  organizations  align  the  selection  and  analyses  of 
processes  more  closely  with  their  business  objectives. 

After  the  organization  attains  capability  level  3  in  the  OPP  and  QPM 
process  areas,  the  organization  can  continue  its  improvement  path  by 
selecting  the  CAR  and  OPM  process  areas.  In  doing  so,  the  organization 
analyzes  the  business  performance  using  statistical  and  other  quantitative 
techniques  to  determine  performance  shortfalls,  and  identifies  and  deploys 
process  and  technology  improvements  that  contribute  to  meeting  quality 
and  process  performance  objectives.  Projects  and  the  organization  use 
causal  analysis  to  identify  and  resolve  issues  affecting  performance  and 
promote  the  dissemination  of  best  practices. 


Understanding  Maturity  Levels 

To  support  those  who  use  the  staged  representation,  all  CMMI  models 
reflect  maturity  levels  in  their  design  and  content.  A  maturity  level  consists 
of  related  specific  and  generic  practices  for  a  predefined  set  of  process 
areas  that  improve  the  organization’s  overall  performance. 

The  maturity  level  of  an  organization  provides  a  way  to  characterize  its 
performance.  Experience  has  shown  that  organizations  do  their  best  when 
they  focus  their  process  improvement  efforts  on  a  manageable  number  of 
process  areas  at  a  time  and  that  those  areas  require  increasing 
sophistication  as  the  organization  improves. 

A  maturity  level  is  a  defined  evolutionary  plateau  for  organizational  process 
improvement.  Each  maturity  level  matures  an  important  subset  of  the 
organization’s  processes,  preparing  it  to  move  to  the  next  maturity  level. 
The  maturity  levels  are  measured  by  the  achievement  of  the  specific  and 
generic  goals  associated  with  each  predefined  set  of  process  areas. 
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The  five  maturity  levels,  each  a  layer  in  the  foundation  for  ongoing  process 
improvement,  are  designated  by  the  numbers  1  through  5: 

1.  Initial 

2.  Managed 

3.  Defined 

4.  Quantitatively  Managed 

5.  Optimizing 

Remember  that  maturity  levels  2  and  3  use  the  same  terms  as  capability 
levels  2  and  3.  This  consistency  of  terminology  was  intentional  because  the 
concepts  of  maturity  levels  and  capability  levels  are  complementary. 
Maturity  levels  are  used  to  characterize  organizational  improvement  relative 
to  a  set  of  process  areas,  and  capability  levels  characterize  organizational 
improvement  relative  to  an  individual  process  area. 

Maturity  Level  1 :  Initial 

At  maturity  level  1 ,  processes  are  usually  ad  hoc  and  chaotic.  The 
organization  usually  does  not  provide  a  stable  environment  to  support 
processes.  Success  in  these  organizations  depends  on  the  competence 
and  heroics  of  the  people  in  the  organization  and  not  on  the  use  of  proven 
processes.  In  spite  of  this  chaos,  maturity  level  1  organizations  acquire 
products  and  services  that  work,  but  they  frequently  exceed  the  budget  and 
schedule  documented  in  their  plans. 

Maturity  level  1  organizations  are  characterized  by  a  tendency  to 
overcommit,  abandon  their  processes  in  a  time  of  crisis,  and  be  unable  to 
repeat  their  successes. 

Maturity  Level  2:  Managed 

At  maturity  level  2,  projects  establish  the  foundation  for  an  organization  to 
become  an  effective  acquirer  of  needed  capabilities  by  institutionalizing 
selected  Project  Management  and  Acquisition  Engineering  processes. 
Projects  define  a  supplier  strategy,  create  project  plans,  and  monitor  and 
control  the  project  to  ensure  the  product  or  service  is  delivered  as  planned. 
The  acquirer  establishes  agreements  with  suppliers  supporting  the  projects 
and  manages  these  agreements  to  ensure  each  supplier  delivers  on 
commitments.  The  acquirer  develops  and  manages  customer  and 
contractual  requirements.  Configuration  management  and  process  and 
product  quality  assurance  are  institutionalized,  and  the  acquirer  develops 
the  capability  to  measure  and  analyze  process  performance. 

Also  at  maturity  level  2,  projects,  processes,  work  products,  and  services 
are  managed.  The  acquirer  ensures  that  processes  are  planned  in 
accordance  with  policy.  To  execute  the  process,  the  acquirer  provides 
adequate  resources,  assigns  responsibility  for  performing  the  process, 
trains  people  on  the  process,  and  ensures  the  designated  work  products  of 
the  process  are  under  appropriate  levels  of  configuration  management.  The 
acquirer  identifies  and  involves  relevant  stakeholders  and  periodically 
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monitors  and  controls  the  process.  Process  adherence  is  periodically 
evaluated  and  process  performance  is  shared  with  senior  management. 

The  process  discipline  reflected  by  maturity  level  2  helps  to  ensure  that 
existing  practices  are  retained  during  times  of  stress. 

Maturity  Level  3:  Defined 

At  maturity  level  3,  acquirers  use  defined  processes  for  managing  projects 
and  suppliers.  They  embed  tenets  of  project  management  and  acquisition 
best  practices,  such  as  integrated  project  management  and  acquisition 
technical  management,  into  the  standard  process  set.  The  acquirer  verifies 
that  selected  work  products  meet  their  requirements  and  validates  products 
and  services  to  ensure  they  meet  the  needs  of  the  customer  and  end  user. 
These  processes  are  well  characterized  and  understood  and  are  described 
in  standards,  procedures,  tools,  and  methods. 

The  organization’s  set  of  standard  processes,  which  is  the  basis  for  maturity 
level  3,  is  established  and  improved  over  time.  These  standard  processes 
are  used  to  establish  consistency  across  the  organization.  Projects 
establish  their  defined  processes  by  tailoring  the  organization’s  set  of 
standard  processes  according  to  tailoring  guidelines.  (See  the  definition  of 
“organization’s  set  of  standard  processes”  in  the  glossary.) 

A  critical  distinction  between  maturity  levels  2  and  3  is  the  scope  of 
standards,  process  descriptions,  and  procedures.  At  maturity  level  2,  the 
standards,  process  descriptions,  and  procedures  can  be  quite  different  in 
each  specific  instance  of  the  process  (e.g.,  on  a  particular  project).  At 
maturity  level  3,  the  standards,  process  descriptions,  and  procedures  for  a 
project  are  tailored  from  the  organization’s  set  of  standard  processes  to  suit 
a  particular  project  or  organizational  unit  and  therefore  are  more  consistent 
except  for  the  differences  allowed  by  the  tailoring  guidelines. 

Another  critical  distinction  is  that  at  maturity  level  3,  processes  are  typically 
described  more  rigorously  than  at  maturity  level  2.  A  defined  process  clearly 
states  the  purpose,  inputs,  entry  criteria,  activities,  roles,  measures, 
verification  steps,  outputs,  and  exit  criteria.  At  maturity  level  3,  processes 
are  managed  more  proactively  using  an  understanding  of  the 
interrelationships  of  process  activities  and  detailed  measures  of  the 
process,  its  work  products,  and  its  services. 

At  maturity  level  3,  the  organization  further  improves  its  processes  that  are 
related  to  the  maturity  level  2  process  areas.  Generic  practices  associated 
with  generic  goal  3  that  were  not  addressed  at  maturity  level  2  are  applied 
to  achieve  maturity  level  3. 

Maturity  Level  4:  Quantitatively  Managed 

At  maturity  level  4,  acquirers  establish  quantitative  objectives  for  quality  and 
process  performance  and  use  them  as  criteria  in  managing  processes. 
Quantitative  objectives  are  based  on  the  needs  of  the  customer,  end  users, 
organization,  and  process  implementers.  Quality  and  process  performance 
is  understood  in  statistical  terms  and  is  managed  throughout  the  life  of 
processes. 
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For  selected  subprocesses,  specific  measures  of  process  performance  are 
collected  and  statistically  analyzed.  When  selecting  subprocesses  for 
analyses,  it  is  critical  to  understand  the  relationships  between  different 
subprocesses  and  their  impact  on  achieving  the  objectives  for  quality  and 
process  performance.  Such  an  approach  helps  to  ensure  that  subprocess 
monitoring  using  statistical  and  other  quantitative  techniques  is  applied  to 
where  it  has  the  most  overall  value  to  the  business.  Process  performance 
baselines  and  models  can  be  used  to  help  set  quality  and  process 
performance  objectives  that  help  achieve  business  objectives. 

A  critical  distinction  between  maturity  levels  3  and  4  is  the  predictability  of 
process  performance.  At  maturity  level  4,  the  performance  of  processes  is 
controlled  using  statistical  and  other  quantitative  techniques  and  predictions 
are  based,  in  part,  on  a  statistical  analysis  of  fine-grained  process  data. 

Maturity  Level  5:  Optimizing 

At  maturity  level  5,  an  organization  continually  improves  its  processes 
based  on  a  quantitative  understanding  of  its  business  objectives  and 
performance  needs.  The  organization  uses  a  quantitative  approach  to 
understand  the  variation  inherent  in  the  process  and  the  causes  of  process 
outcomes. 

Maturity  level  5  focuses  on  continually  improving  process  performance 
through  incremental  and  innovative  process  and  technological 
improvements.  The  organization’s  quality  and  process  performance 
objectives  are  established,  continually  revised  to  reflect  changing  business 
objectives  and  organizational  performance,  and  used  as  criteria  in 
managing  process  improvement.  The  effects  of  deployed  process 
improvements  are  measured  using  statistical  and  other  quantitative 
techniques  and  compared  to  quality  and  process  performance  objectives. 
The  project’s  defined  processes,  the  organization’s  set  of  standard 
processes,  and  supporting  technology  are  targets  of  measurable 
improvement  activities. 

A  critical  distinction  between  maturity  levels  4  and  5  is  the  focus  on 
managing  and  improving  organizational  performance.  At  maturity  level  4, 
the  organization  and  projects  focus  on  understanding  and  controlling 
performance  at  the  subprocess  level  and  using  the  results  to  manage 
projects.  At  maturity  level  5,  the  organization  is  concerned  with  overall 
organizational  performance  using  data  collected  from  multiple  projects. 
Analysis  of  the  data  identifies  shortfalls  or  gaps  in  performance.  These  gaps 
are  used  to  drive  organizational  process  improvement  that  generates 
measureable  improvement  in  performance. 

Advancing  Through  Maturity  Levels 

Organizations  can  achieve  progressive  improvements  in  their  maturity  by 
achieving  control  first  at  the  project  level  and  continuing  to  the  most 
advanced  level — organization-wide  continuous  process  improvement — 
using  both  qualitative  and  quantitative  data  to  make  decisions. 
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Since  improved  organizational  maturity  is  associated  with  improvement  in 
the  range  of  expected  results  that  can  be  achieved  by  an  organization, 
maturity  is  one  way  of  predicting  general  outcomes  of  the  organization’s 
next  project.  For  instance,  at  maturity  level  2,  the  organization  has  been 
elevated  from  ad  hoc  to  disciplined  by  establishing  sound  project 
management.  As  the  organization  achieves  generic  and  specific  goals  for 
the  set  of  process  areas  in  a  maturity  level,  it  increases  its  organizational 
maturity  and  reaps  the  benefits  of  process  improvement.  Because  each 
maturity  level  forms  a  necessary  foundation  for  the  next  level,  trying  to  skip 
maturity  levels  is  usually  counterproductive. 

At  the  same  time,  recognize  that  process  improvement  efforts  should  focus 
on  the  needs  of  the  organization  in  the  context  of  its  business  environment 
and  that  process  areas  at  higher  maturity  levels  can  address  the  current 
and  future  and  future  needs  of  an  organization  or  project. 

For  example,  organizations  seeking  to  move  from  maturity  level  1  to 
maturity  level  2  are  frequently  encouraged  to  establish  a  process  group, 
which  is  addressed  by  the  Organizational  Process  Focus  process  area  at 
maturity  level  3.  Although  a  process  group  is  not  a  necessary  characteristic 
of  a  maturity  level  2  organization,  it  can  be  a  useful  part  of  the 
organization’s  approach  to  achieving  maturity  level  2. 

This  situation  is  sometimes  characterized  as  establishing  a  maturity  level  1 
process  group  to  bootstrap  the  maturity  level  1  organization  to  maturity  level 
2.  Maturity  level  1  process  improvement  activities  may  depend  primarily  on 
the  insight  and  competence  of  the  process  group  until  an  infrastructure  to 
support  more  disciplined  and  widespread  improvement  is  in  place. 

Organizations  can  institute  process  improvements  anytime  they  choose, 
even  before  they  are  prepared  to  advance  to  the  maturity  level  at  which  the 
specific  practice  is  recommended.  In  such  situations,  however, 
organizations  should  understand  that  the  success  of  these  improvements  is 
at  risk  because  the  foundation  for  their  successful  institutionalization  has 
not  been  completed.  Processes  without  the  proper  foundation  can  fail  at  the 
point  they  are  needed  most — under  stress. 

A  defined  process  that  is  characteristic  of  a  maturity  level  3  organization 
can  be  placed  at  great  risk  if  maturity  level  2  management  practices  are 
deficient.  For  example,  management  may  commit  to  a  poorly  planned 
schedule  or  fail  to  control  changes  to  baselined  requirements.  Similarly, 
many  organizations  prematurely  collect  the  detailed  data  characteristic  of 
maturity  level  4  only  to  find  the  data  uninterpretable  because  of 
inconsistencies  in  processes  and  measurement  definitions. 
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Process  Areas 


Process  areas  are  viewed  differently  in  the  two  representations.  Figure  3.2 
compares  views  of  how  process  areas  are  used  in  the  continuous 
representation  and  the  staged  representation. 
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Figure  3.2:  Process  Areas  in  the  Continuous  and  Staged  Representations 
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The  continuous  representation  enables  the  organization  to  choose  the 
focus  of  its  process  improvement  efforts  by  choosing  those  process  areas, 
or  sets  of  interrelated  process  areas,  that  best  benefit  the  organization  and 
its  business  objectives.  Although  there  are  some  limits  on  what  an 
organization  can  choose  because  of  the  dependencies  among  process 
areas,  the  organization  has  considerable  freedom  in  its  selection. 

To  support  those  who  use  the  continuous  representation,  process  areas  are 
organized  into  four  categories:  Process  Management,  Project  Management, 
Acquisition  Engineering,  and  Support.  These  categories  emphasize  some 
of  the  key  relationships  that  exist  among  the  process  areas. 

Sometimes  an  informal  grouping  of  process  areas  is  mentioned:  high 
maturity  process  areas.  The  four  high  maturity  process  areas  are: 
Organizational  Process  Performance,  Quantitative  Project  Management, 
Organizational  Performance  Management,  and  Causal  Analysis  and 
Resolution.  These  process  areas  focus  on  improving  the  performance  of 
implemented  processes  that  most  closely  relate  to  the  organization’s 
business  objectives. 

Once  you  select  process  areas,  you  must  also  select  how  much  you  would 
like  to  mature  processes  associated  with  those  process  areas  (i.e.,  select 
the  appropriate  capability  level).  Capability  levels  and  generic  goals  and 
practices  support  the  improvement  of  processes  associated  with  individual 
process  areas.  For  example,  an  organization  may  wish  to  reach  capability 
level  2  in  one  process  area  and  capability  level  3  in  another.  As  the 
organization  reaches  a  capability  level,  it  sets  its  sights  on  the  next 
capability  level  for  one  of  these  same  process  areas  or  decides  to  widen  its 
view  and  address  a  larger  number  of  process  areas.  Once  it  reaches 
capability  level  3  in  most  of  the  process  areas,  the  organization  can  shift  its 
attention  to  the  high  maturity  process  areas  and  can  track  the  capability  of 
each  through  capability  level  3. 

The  selection  of  a  combination  of  process  areas  and  capability  levels  is 
typically  described  in  a  “target  profile.”  A  target  profile  defines  all  of  the 
process  areas  to  be  addressed  and  the  targeted  capability  level  for  each. 
This  profile  governs  which  goals  and  practices  the  organization  will  address 
in  its  process  improvement  efforts. 

Most  organizations,  at  minimum,  target  capability  level  1  for  the  process 
areas  they  select,  which  requires  that  all  of  these  process  areas’  specific 
goals  be  achieved.  However,  organizations  that  target  capability  levels 
higher  than  1  concentrate  on  the  institutionalization  of  selected  processes  in 
the  organization  by  implementing  generic  goals  and  practices. 

The  staged  representation  provides  a  path  of  improvement  from  maturity 
level  1  to  maturity  level  5  that  involves  achieving  the  goals  of  the  process 
areas  at  each  maturity  level.  To  support  those  who  use  the  staged 
representation,  process  areas  are  grouped  by  maturity  level,  indicating 
which  process  areas  to  implement  to  achieve  each  maturity  level. 

For  example,  at  maturity  level  2,  there  is  a  set  of  process  areas  that  an 
organization  would  use  to  guide  its  process  improvement  until  it  could 
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achieve  all  the  goals  of  all  these  process  areas.  Once  maturity  level  2  is 
achieved,  the  organization  focuses  its  efforts  on  maturity  level  3  process 
areas,  and  so  on.  The  generic  goals  that  apply  to  each  process  area  are 
also  predetermined.  Generic  goal  2  applies  to  maturity  level  2  and  generic 
goal  3  applies  to  maturity  levels  3  through  5. 

Table  3.2  provides  a  list  of  CMMI-ACQ  process  areas  and  their  associated 
categories  and  maturity  levels. 


Table  3.2  Process  Areas,  Categories,  and  Maturity  Levels 


Process  Area 

Category 

Maturity  Level 

Agreement  Management  (AM) 

Project 

Management 

2 

Acquisition  Requirements  Development 
(ARD) 

Acquisition 

Engineering 

2 

Acquisition  Technical  Management 
(ATM) 

Acquisition 

Engineering 

3 

Acquisition  Validation  (AVAL) 

Acquisition 

Engineering 

3 

Acquisition  Verification  (AVER) 

Acquisition 

Engineering 

3 

Causal  Analysis  and  Resolution  (CAR) 

Support 

5 

Configuration  Management  (CM) 

Support 

2 

Decision  Analysis  and  Resolution 
(DAR) 

Support 

3 

Integrated  Project  Management  (IPM) 

Project 

Management 

3 

Measurement  and  Analysis  (MA) 

Support 

2 

Organizational  Process  Definition 
(OPD) 

Process 

Management 

3 

Organizational  Process  Focus  (OPF) 

Process 

Management 

3 

Organizational  Performance 

Management  (OPM) 

Process 

Management 

5 

Organizational  Process  Performance 
(OPP) 

Process 

Management 

4 

Organizational  Training  (OT) 

Process 

Management 

3 

Project  Monitoring  and  Control  (PMC) 

Project 

Management 

2 

Project  Planning  (PP) 

Project 

Management 

2 
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Process  and  Product  Quality  Assurance 
(PPQA) 

Support 

2 

Quantitative  Project  Management 
(QPM) 

Project 

Management 

4 

Requirements  Management  (REQM) 

Project 

Management 

2 

Risk  Management  (RSKM) 

Project 

Management 

3 

Solicitation  and  Supplier  Agreement 
Development  (SSAD) 

Project 

Management 

2 

Equivalent  Staging 


Equivalent  staging  is  a  way  to  compare  results  from  using  the  continuous 
representation  to  results  from  using  the  staged  representation.  In  essence, 
if  you  measure  improvement  relative  to  selected  process  areas  using 
capability  levels  in  the  continuous  representation,  how  do  you  translate  that 
work  into  maturity  levels?  Is  this  translation  possible? 

Up  to  this  point,  we  have  not  discussed  process  appraisals  in  much  detail. 
The  SCAMPIsm  method9  is  used  to  appraise  organizations  using  CMMI,  and 
one  result  of  an  appraisal  is  a  rating  [SEI  2011a,  Ahern  2005].  If  the 
continuous  representation  is  used  for  an  appraisal,  the  rating  is  a  “capability 
level  profile.”  If  the  staged  representation  is  used  for  an  appraisal,  the  rating 
is  a  “maturity  level  rating”  (e.g.,  maturity  level  3). 

A  capability  level  profile  is  a  list  of  process  areas  and  the  corresponding 
capability  level  achieved  for  each.  This  profile  enables  an  organization  to 
track  its  capability  level  by  process  area.  The  profile  is  called  an 
“achievement  profile”  when  it  represents  the  organization’s  actual  progress 
for  each  process  area.  Alternatively,  the  profile  is  called  a  “target  profile” 
when  it  represents  the  organization’s  planned  process  improvement 
objectives. 

Figure  3.3  illustrates  a  combined  target  and  achievement  profile.  The  gray 
portion  of  each  bar  represents  what  has  been  achieved.  The  unshaded 
portion  represents  what  remains  to  be  accomplished  to  meet  the  target 
profile. 


9  The  Standard  CMMI  Appraisal  Method  for  Process  Improvement  (SCAMPI)  method  is  described  in  Chapter  5. 
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Requirements  Management 

Project  Planning 

Project  Monitoring 
and  Control 

Agreement  Management 

Measurement  and  Analysis 

Process  and  Product 
Quality  Assurance 

Configuration  Management 


Capability  Capability  Capability 

Level  1  Level  2  Level  3 


Figure  3.3:  Example  Combined  Target  and  Achievement  Profile 

An  achievement  profile,  when  compared  with  a  target  profile,  enables  an 
organization  to  plan  and  track  its  progress  for  each  selected  process  area. 
Maintaining  capability  level  profiles  is  advisable  when  using  the  continuous 
representation. 

Target  staging  is  a  sequence  of  target  profiles  that  describes  the  path  of 
process  improvement  to  be  followed  by  the  organization.  When  building 
target  profiles,  the  organization  should  pay  attention  to  the  dependencies 
between  generic  practices  and  process  areas.  If  a  generic  practice  depends 
on  a  process  area,  either  to  carry  out  the  generic  practice  or  to  provide  a 
prerequisite  work  product,  the  generic  practice  can  be  much  less  effective 
when  the  process  area  is  not  implemented.10 

Although  the  reasons  to  use  the  continuous  representation  are  many, 
ratings  consisting  of  capability  level  profiles  are  limited  in  their  ability  to 
provide  organizations  with  a  way  to  generally  compare  themselves  with 
other  organizations.  Capability  level  profiles  can  be  used  if  each 
organization  selects  the  same  process  areas;  however,  maturity  levels  have 
been  used  to  compare  organizations  for  years  and  already  provide 
predefined  sets  of  process  areas. 

Because  of  this  situation,  equivalent  staging  was  created.  Equivalent 
staging  enables  an  organization  using  the  continuous  representation  to 
convert  a  capability  level  profile  to  the  associated  maturity  level  rating. 

The  most  effective  way  to  depict  equivalent  staging  is  to  provide  a 
sequence  of  target  profiles,  each  of  which  is  equivalent  to  a  maturity  level 
rating  of  the  staged  representation  reflected  in  the  process  areas  listed  in 


10  See  Table  6.2  in  the  Generic  Goals  and  Generic  Practices  section  of  Part  Two  for  more  information  about  the  dependencies 
between  generic  practices  and  process  areas. 
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the  target  profile.  The  result  is  a  target  staging  that  is  equivalent  to  the 
maturity  levels  of  the  staged  representation. 

Figure  3.4  shows  a  summary  of  the  target  profiles  that  must  be  achieved 
when  using  the  continuous  representation  to  be  equivalent  to  maturity 
levels  2  through  5.  Each  shaded  area  in  the  capability  level  columns 
represents  a  target  profile  that  is  equivalent  to  a  maturity  level. 


Figure  3.4:  Target  Profiles  and  Equivalent  Staging 


38 


Tying  It  All  Together 


CMMI  for  Acquisition,  Version  1.3 


The  following  rules  summarize  equivalent  staging: 

•  To  achieve  maturity  level  2,  all  process  areas  assigned  to  maturity  level 
2  must  achieve  capability  level  2  or  3. 

•  To  achieve  maturity  level  3,  all  process  areas  assigned  to  maturity 
levels  2  and  3  must  achieve  capability  level  3. 

•  To  achieve  maturity  level  4,  all  process  areas  assigned  to  maturity 
levels  2,  3,  and  4  must  achieve  capability  level  3. 

•  To  achieve  maturity  level  5,  all  process  areas  must  achieve  capability 
level  3. 


Achieving  High  Maturity 


When  using  the  staged  representation,  you  attain  high  maturity  when  you 
achieve  maturity  level  4  or  5.  Achieving  maturity  level  4  involves 
implementing  all  process  areas  for  maturity  levels  2,  3,  and  4.  Likewise, 
achieving  maturity  level  5  involves  implementing  all  process  areas  for 
maturity  levels  2,  3,  4,  and  5. 

When  using  the  continuous  representation,  you  attain  high  maturity  using 
the  equivalent  staging  concept.  High  maturity  that  is  equivalent  to  staged 
maturity  level  4  using  equivalent  staging  is  attained  when  you  achieve 
capability  level  3  for  all  process  areas  except  for  Organizational 
Performance  Management  (OPM)  and  Causal  Analysis  and  Resolution 
(CAR).  High  maturity  that  is  equivalent  to  staged  maturity  level  5  using 
equivalent  staging  is  attained  when  you  achieve  capability  level  3  for  all 
process  areas. 
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4  Relationships  Among  Process  Areas 


In  this  chapter  we  describe  the  key  relationships  among  process  areas  to 
help  you  see  the  acquirer’s  view  of  process  improvement  and  how  process 
areas  depend  on  the  implementation  of  other  process  areas. 

The  relationships  among  multiple  process  areas,  including  the  information 
and  artifacts  that  flow  from  one  process  area  to  another — illustrated  by  the 
figure  and  descriptions  in  this  chapter — help  you  to  see  a  larger  view  of 
process  implementation  and  improvement. 

Successful  process  improvement  initiatives  must  be  driven  by  the  business 
objectives  of  the  organization.  For  example,  a  common  business  objective 
is  to  reduce  the  time  it  takes  to  get  a  product  to  market.  The  process 
improvement  objective  derived  from  that  might  be  to  improve  the  project 
management  processes  to  ensure  on-time  delivery.  Those  improvements 
rely  on  best  practices  in  the  Project  Planning  and  Project  Monitoring  and 
Control  process  areas. 

Although  we  group  process  areas  in  this  chapter  to  simplify  the  discussion 
of  their  relationships,  process  areas  often  interact  and  have  an  effect  on 
one  another  regardless  of  their  group,  category,  or  level.  For  example,  the 
Decision  Analysis  and  Resolution  process  area  (a  Support  process  area  at 
maturity  level  3)  contains  specific  practices  that  address  the  formal 
evaluation  process  used  in  the  Solicitation  and  Supplier  Agreement 
Development  process  area  (a  Project  Management  process  area  at 
maturity  level  2)  to  select  suppliers  to  deliver  a  product  or  service. 

Being  aware  of  the  key  relationships  that  exist  among  CMMI  process  areas 
will  help  you  apply  CMMI  in  a  useful  and  productive  way.  Relationships 
among  process  areas  are  described  in  more  detail  in  the  references  of  each 
process  area  and  specifically  in  the  Related  Process  Areas  section  of  each 
process  area  in  Part  Two.  Refer  to  Chapter  2  for  more  information  about 
references. 

Figure  4.1  illustrates  key  relationships  among  CMMI-ACQ  process  areas. 


Relationships  Among  Process  Areas 


41 


CMMI  for  Acquisition,  Version  1.3 


Project  Processes 


The  project  process  areas  contain  practices  that  address  acquirer  activities 
related  to  establishing,  executing,  and  ensuring  the  transition  of  an 
acquisition  project. 

The  project  process  areas  of  CMMI-ACQ  contain  the  following  process 
areas  from  the  Project  Management  and  Acquisition  Engineering 
categories: 

Project  Management 

•  Project  Planning  (PP) 

•  Requirements  Management  (REQM) 

•  Solicitation  and  Supplier  Agreement  Development  (SSAD) 

•  Agreement  Management  (AM) 
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•  Project  Monitoring  and  Control  (PMC) 

•  Integrated  Project  Management  (IPM) 

•  Risk  Management  (RSKM) 


Acquisition  Engineering 

•  Acquisition  Requirements  Development  (ARD) 

•  Acquisition  Technical  Management  (ATM) 

•  Acquisition  Verification  (AVER) 

•  Acquisition  Validation  (AVAL) 

The  Project  Planning  process  area  includes  practices  for  determining  the 
acquisition  strategy,  developing  the  project  plan,  involving  stakeholders 
appropriately,  obtaining  commitment  to  the  plan,  and  maintaining  the  plan. 

Planning  begins  with  the  acquisition  strategy,  which  provides  the  framework 
for  the  acquisition  project  and  its  plans.  The  project  plan  covers  the  project 
management  and  acquisition  activities  performed  by  the  project.  Other 
plans  (e.g.,  plans  for  transition  to  operations  and  support,  configuration 
management,  verification,  and  measurement  and  analysis)  from  relevant 
stakeholders  that  affect  the  project  are  reviewed,  and  commitments  with 
those  stakeholders  for  their  contributions  to  the  project  are  established. 

Once  the  acquisition  strategy  is  established  using  Project  Planning 
practices,  the  strategy  is  used  to  focus  on  specifying  customer  and 
contractual  requirements  that  express  customer  value  in  Acquisition 
Requirements  Development  practices.  Customer  needs  are  established  and 
translated  into  customer  requirements.  The  set  of  customer  requirements  is 
prioritized  and  a  set  of  contractual  requirements,  including  design 
constraints,  is  developed. 

Development  of  contractual  requirements  and  operational  scenarios  also 
depends  on  the  acquisition  strategy  developed  using  Project  Planning 
practices.  This  set  of  contractual  requirements  is  used  in  Solicitation  and 
Supplier  Agreement  Development  practices  to  select  suppliers  and 
establish  a  supplier  agreement  to  acquire  the  product  or  service.  The 
product  or  service  is  designed  and  implemented  by  the  supplier  consistent 
with  the  acquirer’s  contractual  requirements  and  design  constraints. 

Requirements  are  maintained  using  Requirements  Management  practices. 
These  practices  describe  activities  for  obtaining  and  controlling  requirement 
changes  and  ensuring  that  other  relevant  plans  and  data  are  kept  current. 
They  also  describe  the  traceability  of  requirements  from  customer  to 
contractual  requirements  and  supplier  agreements.  Requirements 
Management  practices  interact  with  Acquisition  Requirements  Development 
practices.  All  changes  to  contractual  requirements  must  be  reflected  in  the 
supplier  agreements  established  and  maintained  using  Solicitation  and 
Supplier  Agreement  Development  practices. 


Relationships  Among  Process  Areas 


43 


CMMI  for  Acquisition,  Version  1.3 


The  Solicitation  and  Supplier  Agreement  Development  process  area 
defines  practices  for  preparing  a  solicitation  package,  selecting  a  capable 
supplier,  and  establishing  and  maintaining  the  supplier  agreement.  The 
acquisition  strategy  developed  using  Project  Planning  practices  and 
contractual  requirements  developed  using  Acquisition  Requirements 
Development  practices  are  a  prerequisite  to  prepare  for  Solicitation  and 
Suppler  Agreement  Development  practices.  An  agreement  is  developed  to 
acquire  the  product  or  service  by  identifying  potential  suppliers,  developing 
the  solicitation  package,  and  distributing  it  to  the  potential  suppliers.  The 
acquirer  evaluates  the  proposed  solutions  and  negotiates  with  the  supplier 
to  finalize  the  agreement  so  that  both  the  acquirer  and  supplier  have  a 
mutual  understanding  of  the  agreement.  This  agreement  is  established  and 
maintained  using  Solicitation  and  Supplier  Agreement  Development,  but  the 
execution  of  the  agreement  is  performed  using  Agreement  Management 
practices. 

The  acquirer  uses  Agreement  Management  practices  to  manage  the 
supplier  agreement  by  performing  the  acquirer  activities  defined  in  the 
supplier  agreement,  monitoring  selected  supplier  processes,  accepting  the 
product  or  service,  and  managing  supplier  invoices. 

After  a  supplier  is  selected  and  a  supplier  agreement  is  established,  the 
acquirer  continues  to  apply  Requirements  Management  practices  to 
manage  customer  and  contractual  requirements,  while  the  selected  supplier 
is  managing  the  refined  product  and  product  component  requirements. 

Using  Requirements  Management  practices  ensures  that  changes  to 
requirements  are  reflected  in  project  plans,  activities,  and  work  products. 
This  cycle  of  changes  can  affect  or  be  affected  by  other  processes;  thus, 
the  requirements  management  process  is  a  dynamic  and  often  recursive 
sequence  of  events. 

The  Project  Monitoring  and  Control  process  area  contains  practices  for 
monitoring  and  controlling  acquirer  activities  and  overseeing  the  supplier’s 
project  progress  and  performance  according  to  project  plans.  The  process 
area  includes  coverage  of  monitoring  and  controlling  the  transition  to 
operations  and  support  that  was  planned  using  Project  Planning  practices. 

Project  Monitoring  and  Control  practices  also  cover  taking  corrective  action. 
The  project  plan  specifies  the  frequency  of  progress  reviews  and  the 
measures  used  to  monitor  progress.  Progress  is  determined  primarily  by 
comparing  project  status  to  the  plan.  When  the  actual  status  deviates 
significantly  from  expected  values,  corrective  actions  are  taken  as 
appropriate.  These  actions  can  include  replanning,  which  requires  using 
Project  Planning  practices. 
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As  the  acquirer’s  processes  improve  in  capability,  Integrated  Project 
Management  practices  are  used  to  manage  the  project  using  a  defined 
process  tailored  from  the  organization’s  set  of  standard  processes 
(Organizational  Process  Development).  The  project  uses  and  contributes  to 
organizational  process  assets,  the  project’s  work  environment  is 
established  and  maintained  from  the  organization’s  work  environment 
standards,  and  teams  are  established  using  the  organization’s  rules  and 
guidelines.  The  project’s  relevant  stakeholders  coordinate  their  efforts  in  a 
timely  manner  through  the  identification,  negotiation,  and  tracking  of  critical 
dependencies  and  the  resolution  of  coordination  issues. 

In  the  acquirer-supplier  relationship,  the  need  for  an  early  and  aggressive 
detection  of  risk  is  compounded  by  the  complexity  of  projects  acquiring 
products  or  services.  The  purpose  of  Risk  Management  is  to  identify  and 
assess  project  risks  during  the  project  planning  process  and  to  manage 
these  risks  throughout  the  project. 

The  acquirer  has  a  dual  role:  first,  to  assess  and  manage  overall  project 
risks  for  the  duration  of  the  project,  and  second,  to  assess  and  manage 
risks  associated  with  the  performance  of  the  supplier.  As  the  acquisition 
progresses  to  the  selection  of  a  supplier,  the  risks  specific  to  the  supplier’s 
technical  and  management  approach  become  more  important  to  the 
success  of  the  acquisition. 

Although  risk  identification  and  monitoring  are  covered  in  the  Project 
Planning  and  Project  Monitoring  and  Control  process  areas,  using  the  Risk 
Management  process  area  enables  the  acquirer  to  take  a  continuing, 
forward-looking  approach  to  managing  risks  with  activities  that  include 
identification  of  risk  parameters,  risk  assessments,  and  risk  mitigation. 

Acquisition  Technical  Management  practices  are  used  to  combine  the 
project’s  defined  process  and  risk  management  activities  to  perform 
technical  and  interface  management.  This  management  includes  activities 
such  as  managing  the  technical  evaluation  of  selected  supplier  products 
and  services,  conducting  technical  reviews  with  the  supplier,  and  managing 
selected  interfaces  throughout  the  project’s  lifecycle.  Acquisition  Technical 
Management  practices,  Agreement  Management  practices,  and  the  Project 
Monitoring  and  Control  practices  are  all  used  in  concert,  as  they  all  contain 
reviews  that  are  conducted  throughout  the  project. 

Using  Acquisition  Verification  practices  ensures  that  the  acquirer’s  selected 
work  products  meet  specified  requirements.  Using  Acquisition  Verification 
practices  also  enables  the  acquirer  to  select  work  products  and  verification 
methods  to  verify  acquirer  work  products  against  specified  requirements. 

Acquisition  Verification  practices  also  are  used  to  address  peer  reviews. 
Peer  reviews  are  a  proven  method  for  removing  defects  early  and  provide 
valuable  insight  into  the  work  products  and  product  components  being 
developed  and  maintained  by  the  acquirer. 

The  acquirer  uses  Acquisition  Validation  processes  to  ensure  that  the 
products  or  services  received  from  the  supplier  will  fulfill  the  relevant 
stakeholders’  needs.  Products  and  services  are  incrementally  validated 
against  the  customer’s  needs. 
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Validation  can  be  performed  in  the  operational  environment  or  in  a 
simulated  operational  environment.  Coordination  with  the  customer  on  the 
validation  requirements  is  an  important  element  of  this  process  area. 

The  scope  of  the  Acquisition  Validation  process  area  includes  the  validation 
of  products,  product  components,  selected  intermediate  work  products,  and 
processes.  These  validated  elements  can  often  require  reverification  and 
revalidation.  Issues  discovered  during  validation  are  usually  resolved  using 
Acquisition  Requirements  Development  practices  or  by  working  with  the 
supplier  through  the  supplier  agreement  and  technical  reviews. 

As  mentioned  above,  Integrated  Project  Management  processes  establish  a 
defined  process  and  integrated  plan  for  managing  all  the  activities  of  the 
project.  These  activities  include  all  project  processes  described  above,  from 
Project  Planning  through  Acquisition  Validation.  The  organization’s  set  of 
standard  processes  and  other  process  assets  provide  critical  guidance  to 
projects  for  establishing  a  defined  process  and  plan.  How  the  organization 
creates  and  deploys  such  process  assets  for  use  by  the  whole  organization, 
along  with  other  forms  of  critical  project  support,  is  the  subject  of  the  next 
section. 


Organizational  Processes 


Organizational  process  areas  contain  the  cross-project  activities  related  to 
defining,  planning,  deploying,  implementing,  monitoring,  controlling, 
appraising,  measuring,  and  improving  processes. 

The  organizational  process  areas  contain  practices  that  provide  the 
acquiring  organization  with  a  capability  to  develop  and  deploy  processes 
and  supporting  assets  and  to  document  and  share  best  practices  and 
learning  across  the  organization. 

The  three  organizational  process  areas  in  CMMI-ACQ  are  as  follows: 

•  Organizational  Process  Definition  (OPD) 

•  Organizational  Process  Focus  (OPF) 

•  Organizational  Training  (OT) 

Organizational  Process  Focus  practices  help  the  acquiring  organization  to 
plan,  implement,  and  deploy  organizational  process  improvements  based 
on  an  understanding  of  the  current  strengths  and  weaknesses  of  the 
organization’s  processes  and  process  assets.  Candidate  improvements  to 
the  organization’s  processes  are  obtained  through  activities  in  the 
processes  of  related  projects.  These  activities  include  generating  process 
improvement  proposals,  measuring  processes,  collecting  lessons  learned  in 
implementing  the  processes,  and  evaluating  products  and  services. 

Using  Organizational  Process  Focus  practices,  the  acquirer  encourages 
participation  of  suppliers  in  process  improvement  activities.  Suppliers  can 
be  involved  in  developing  process  action  plans  if  processes  that  define 
interfaces  between  the  acquirer  and  supplier  are  targeted  for  improvement. 
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Organizational  Process  Definition  practices  form  the  basis  for  establishing 
and  maintaining  the  organization’s  set  of  standard  processes,  work 
environment  standards,  rules  and  guidelines  for  the  operation  of  teams,  and 
other  assets  based  on  the  process  needs  and  objectives  of  the 
organization. 

These  other  assets  include  descriptions  of  lifecycle  models,  process 
tailoring  guidelines,  and  process-related  documentation  and  data.  Projects 
tailor  the  organization’s  set  of  standard  processes  to  create  their  defined 
processes  using  Integrated  Project  Management  practices.  Experiences 
and  work  products  from  performing  these  defined  processes,  including 
measurement  data,  process  descriptions,  process  artifacts,  and  lessons 
learned,  are  incorporated,  as  appropriate,  into  the  organization’s  set  of 
standard  processes  and  other  assets. 

The  acquirer’s  set  of  standard  processes  can  also  describe  standard 
interactions  with  suppliers.  Supplier  interactions  are  typically  characterized 
by  the  deliverables  expected  from  suppliers,  acceptance  criteria  applicable 
to  those  deliverables,  standards  (e.g.,  architecture  and  technology 
standards),  and  standard  milestone  and  progress  reviews.  The  acquirer 
defines  in  the  supplier  agreement  how  changes  to  organizational  process 
assets  that  affect  the  supplier  (e.g.,  standard  supplier  deliverables, 
acceptance  criteria)  are  deployed. 

The  purpose  of  implementing  Organizational  Training  practices  is  to 
develop  the  skills  and  knowledge  of  people  so  they  can  perform  their  roles 
effectively  and  efficiently.  For  example,  an  acquiring  organization  may  want 
to  develop  its  project  managers’  capabilities  in  managing  supplier 
agreements. 

Using  Organizational  Training  practices  helps  the  acquirer  identify  the 
strategic  training  needs  of  the  organization  as  well  as  the  tactical  training 
needs  that  are  common  across  projects  and  support  groups.  In  particular, 
training  is  created  or  obtained  to  develop  the  skills  required  to  perform  the 
organization’s  set  of  standard  processes.  The  main  components  of  training 
include  a  managed  training  development  program,  documented  plans,  staff 
with  appropriate  knowledge,  and  mechanisms  for  measuring  the 
effectiveness  of  the  training  program. 


Support  Processes 


The  Support  process  areas  address  acquisition  project  processes  and  can 
address  processes  that  apply  more  generally  to  the  organization.  For 
example,  Process  and  Product  Quality  Assurance  practices  can  be  used  to 
provide  an  objective  evaluation  of  the  processes  and  work  products 
described  in  all  the  process  areas. 

Although  all  Support  process  areas  rely  on  other  process  areas  for  input, 
some  Support  process  areas  provide  support  functions  that  also  help 
implement  several  generic  practices. 
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The  four  Support  process  areas  in  CMMI-ACQ  are  as  follows: 

•  Configuration  Management  (CM) 

•  Decision  Analysis  and  Resolution  (DAR) 

•  Measurement  and  Analysis  (MA) 

•  Process  and  Product  Quality  Assurance  (PPQA) 

The  Measurement  and  Analysis  process  area  is  related  to  other  process 
areas  because  its  practices  guide  projects  and  organizations  in  aligning 
measurement  needs  and  objectives  with  a  measurement  approach  that  is 
used  to  support  management  information  needs.  The  results  can  be  used  in 
making  informed  decisions  and  taking  appropriate  corrective  actions. 

An  acquirer  uses  Measurement  and  Analysis  practices  to  support  the 
information  needs  of  the  organization  and  project.  Some  of  this  information 
may  be  needed  from  the  acquirer,  some  from  the  supplier,  and  some  from 
all  parts  of  a  project.  Supplier  Solicitation  and  Agreement  Development 
describes  how  these  measures  are  specified  in  the  solicitation  process  and 
supplier  agreement.  The  measurement  results  from  the  acquirer  and 
supplier  support  project,  supplier,  and  technical  reviews  through  project 
monitoring  and  control,  agreement  management,  and  acquisition  technical 
management. 

The  Process  and  Product  Quality  Assurance  process  area  is  related  to  all 
process  areas  because  it  describes  specific  practices  for  objectively 
evaluating  performed  processes  and  work  products  against  applicable 
process  descriptions,  standards,  and  procedures,  and  by  ensuring  that 
issues  arising  from  these  evaluations  are  addressed.  Process  and  Product 
Quality  Assurance  practices  support  the  acquisition  of  high  quality  products 
and  services  by  providing  the  acquirer  with  appropriate  visibility  into,  and 
feedback  on,  the  processes  and  associated  work  products  throughout  the 
life  of  the  project. 

The  Configuration  Management  process  area  is  related  to  all  process  areas 
because  its  practices  describe  establishing  and  maintaining  the  integrity  of 
work  products  using  configuration  identification,  configuration  control, 
configuration  status  accounting,  and  configuration  audits.  The  work 
products  placed  under  configuration  control  include  the  products  that  are 
delivered  to  the  customer,  designated  internal  work  products,  acquired 
products,  tools,  and  other  items  that  are  used  in  creating  and  describing 
these  work  products. 

Examples  of  work  products  that  can  be  placed  under  configuration  control 
include  plans,  process  descriptions,  and  requirements.  Suppliers  can  play  a 
part  in  any  of  these  activities  on  behalf  of  the  acquirer,  so  the  supplier 
agreement  should  specify  the  configuration  management  roles  and 
responsibilities  of  the  acquirer  and  supplier.  Configuration  management  of 
acquired  products  (both  final  and  interim  products)  created  by  the  suppliers 
requires  monitoring  to  ensure  that  project  requirements  are  met. 
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The  Decision  Analysis  and  Resolution  process  area  is  related  to  all  process 
areas  because  its  practices  describe  determining  which  issues  should  be 
subjected  to  a  formal  evaluation  process  and  applying  a  formal  evaluation 
process  to  them.  A  repeatable  Decision  Analysis  and  Resolution  process  is 
important  for  an  acquirer  when  making  the  critical  decisions  that  define  and 
guide  the  acquisition  process  and  later  when  critical  decisions  are  made 
with  the  selected  supplier. 


High  Maturity  Processes 


High  maturity  process  areas  describe  practices  that  further  align 
organizational,  project,  and  support  processes  with  the  business  objectives 
of  the  organization.  These  process  areas  describe  practices  at  both  the 
organizational  and  project  level  for  establishing  objectives  for  quality  and 
process  performance,  monitoring  variation  in  the  organization’s  and 
projects’  processes,  evaluating  the  impacts  of  proposed  changes  to  those 
processes,  and  systematically  deploying  processes  across  the  organization. 
To  effectively  implement  these  practices,  mature  measurement  and 
analysis  processes  are  needed. 

The  acquirer  achieves  an  effective  implementation  of  high  maturity 
practices  by  ensuring  that  all  members  of  the  organization  collect  and 
analyze  measurements  and  propose  and  evaluate  changes  to  processes.  In 
other  words,  high  maturity  practices  should  be  integrated  as  much  as 
possible  with  the  practices  in  other  process  areas. 

The  four  high  maturity  process  areas  in  CMMI-ACQ  are  as  follows: 

•  Organizational  Process  Performance  (OPP) 

•  Quantitative  Project  Management  (QPM) 

•  Causal  Analysis  and  Resolution  (CAR) 

•  Organizational  Performance  Management  (OPM) 

At  the  organizational  level,  the  acquirer  uses  the  Organizational  Process 
Performance  practices  to  derive  quantitative  objectives  for  quality  and 
process  performance  from  the  organization’s  business  objectives  and  the 
customer.  Processes  and  subprocesses  critical  to  achieving  the  quality  and 
process  performance  objectives  are  identified  along  with  measurements  to 
characterize  performance.  Using  collected  measurement  data,  process 
performance  models  and  process  performance  baselines  are  created, 
updated,  and  used  to  analyze  process  performance. 

Quantitative  Project  Management  practices  describe  applying  statistical  and 
other  quantitative  techniques  to  manage  process  performance  and  product 
quality.  The  project’s  quality  and  process  performance  objectives  are  based 
on  the  objectives  established  by  the  organization.  The  project’s  defined 
process  is  composed  based,  in  part,  on  an  analysis  of  historical  process 
performance  data.  Process  performance  baselines  and  models  enable  the 
project  to  predict  whether  or  not  it  can  achieve  its  quality  and  process 
performance  objectives.  Based  on  the  prediction,  the  project  can  adjust  its 
defined  process,  subprocesses,  plans,  or  may  negotiate  changes  to  its 
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objectives.  The  project  monitors  process  performance  throughout  the 
project  and  takes  corrective  action  as  needed. 

In  Organizational  Performance  Management,  process  performance 
baselines  and  models  are  analyzed  to  understand  the  organization’s  ability 
to  meet  its  business  objectives  and  to  derive  quality  and  process 
performance  objectives.  Based  on  this  understanding,  the  organization 
proactively  selects  and  deploys  incremental  and  innovative  improvements 
that  measurably  improve  the  organization’s  performance.  The  identification 
of  promising  incremental  and  innovative  improvements  should  involve  the 
participation  of  an  empowered  workforce  aligned  with  the  business  values 
and  objectives  of  the  organization.  The  selection  of  improvements  to  deploy 
is  based  on  a  quantitative  understanding  of  the  likely  benefits  and  predicted 
costs  of  deploying  candidate  improvements.  The  organization  can  also 
adjust  business  objectives  and  quality  and  process  performance  objectives 
as  appropriate. 

Acquirers  use  Causal  Analysis  and  Resolution  practices  to  identify  causes 
of  selected  outcomes  and  take  action  to  prevent  negative  outcomes  from 
occurring  in  the  future  or  to  leverage  positive  outcomes.  While  the  project’s 
defined  processes  are  the  initial  targets  for  root  cause  analysis  and  action 
plans,  effective  process  changes  can  result  in  process  improvement 
proposals  submitted  to  the  organization’s  set  of  standard  processes. 

Together,  the  high  maturity  processes  enable  the  organization  to  achieve  its 
quantitative  objectives  for  quality  and  process  performance. 
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5  Using  CMMI  Models 


The  complexity  of  products  today  demands  an  integrated  view  of  how 
organizations  do  business.  CMMI  can  reduce  the  cost  of  process 
improvement  across  enterprises  that  depend  on  multiple  functions  or 
groups  to  achieve  their  objectives. 

To  achieve  this  integrated  view,  the  CMMI  Framework  includes  common 
terminology,  common  model  components,  common  appraisal  methods,  and 
common  training  materials.  This  chapter  describes  how  organizations  can 
use  the  CMMI  Product  Suite  not  only  to  improve  their  quality,  reduce  their 
costs,  and  optimize  their  schedules,  but  also  to  gauge  how  well  their 
process  improvement  program  is  working. 


Adopting  CMMI 


Research  has  shown  that  the  most  powerful  initial  step  to  process 
improvement  is  to  build  organizational  support  through  strong  senior 
management  sponsorship.  To  gain  the  sponsorship  of  senior  management, 
it  is  often  beneficial  to  expose  them  to  the  performance  results  experienced 
by  others  who  have  used  CMMI  to  improve  their  processes  [Gibson  2006]. 

For  more  information  about  CMMI  performance  results,  see  the  SEI  website 
at  http://www.sei.cmu.edu/cmmi/research/results/. 

The  senior  manager,  once  committed  as  the  process  improvement  sponsor, 
must  be  actively  involved  in  the  CMMI-based  process  improvement  effort. 
Activities  performed  by  the  senior  management  sponsor  include  but  are  not 
limited  to  the  following: 

•  Influence  the  organization  to  adopt  CMMI 

•  Choose  the  best  people  to  manage  the  process  improvement  effort 

•  Monitor  the  process  improvement  effort  personally 

•  Be  a  visible  advocate  and  spokesperson  for  the  process  improvement 
effort 

•  Ensure  that  adequate  resources  are  available  to  enable  the  process 
improvement  effort  to  be  successful 

Given  sufficient  senior  management  sponsorship,  the  next  step  is 
establishing  a  strong,  technically  competent  process  group  that  represents 
relevant  stakeholders  to  guide  process  improvement  efforts  [Ahern  2008]. 

For  an  organization  with  a  mission  to  develop  software-intensive  systems, 
the  process  group  might  include  those  who  represent  different  disciplines 
across  the  organization  and  other  selected  members  based  on  the  business 
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needs  driving  improvement.  For  example,  a  systems  administrator  may 
focus  on  information  technology  support,  whereas  a  marketing 
representative  may  focus  on  integrating  customers’  needs.  Both  members 
could  make  powerful  contributions  to  the  process  group. 

Once  your  organization  decides  to  adopt  CMMI,  planning  can  begin  with  an 
improvement  approach  such  as  the  IDEALSM  (Initiating,  Diagnosing, 
Establishing,  Acting,  and  Learning)  model  [McFeeley  1996].  For  more 
information  about  the  IDEAL  model,  see  the  SEI  website  at 
http://www.sei.cmu.edu/library/abstracts/reports/96hb001  .cfm. 


Your  Process  Improvement  Program 


Use  the  CMMI  Product  Suite  to  help  establish  your  organization’s  process 
improvement  program.  Using  the  product  suite  for  this  purpose  can  be  a 
relatively  informal  process  that  involves  understanding  and  applying  CMMI 
best  practices  to  your  organization.  Or,  it  can  be  a  formal  process  that 
involves  extensive  training,  creation  of  a  process  improvement 
infrastructure,  appraisals,  and  more. 


Selections  that  Influence  Your  Program 


You  must  make  three  selections  to  apply  CMMI  to  your  organization  for 
process  improvement: 

1.  Select  a  part  of  the  organization. 

2.  Select  a  model. 

3.  Select  a  representation. 

Selecting  the  projects  to  be  involved  in  your  process  improvement  program 
is  critical.  If  you  select  a  group  that  is  too  large,  it  may  be  too  much  for  the 
initial  improvement  effort.  The  selection  should  also  consider  organizational, 
product,  and  work  homogeneity  (i.e.,  whether  the  group’s  members  all  are 
experts  in  the  same  discipline,  whether  they  all  work  on  the  same  product 
or  business  line,  and  so  on). 

Selecting  an  appropriate  model  is  also  essential  to  a  successful  process 
improvement  program.  The  CMMI-DEV  model  focuses  on  activities  for 
developing  quality  products  and  services.  The  CMMI-ACQ  model  focuses 
on  activities  for  initiating  and  managing  the  acquisition  of  products  and 
services.  The  CMMI-SVC  model  focuses  on  activities  for  providing  quality 
services  to  the  customer  and  end  users.  When  selecting  a  model, 
appropriate  consideration  should  be  given  to  the  primary  focus  of  the 
organization  and  projects,  as  well  as  to  the  processes  necessary  to  satisfy 
business  objectives.  The  lifecycle  processes  (e.g.,  conception,  design, 
manufacture,  deployment,  operations,  maintenance,  disposal)  on  which  an 
organization  concentrates  should  also  be  considered  when  selecting  an 
appropriate  model. 
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Select  the  representation  (capability  or  maturity  levels)  that  fits  your  concept 
of  process  improvement.  Regardless  of  which  you  choose,  you  can  select 
nearly  any  process  area  or  group  of  process  areas  to  guide  improvement, 
although  dependencies  among  process  areas  should  be  considered  when 
making  such  a  selection. 

As  process  improvement  plans  and  activities  progress,  other  important 
selections  must  be  made,  including  whether  to  use  an  appraisal,  which 
appraisal  method  should  be  used,  which  projects  should  be  appraised,  how 
training  for  staff  should  be  secured,  and  which  staff  members  should  be 
trained. 


CMMI  Models 


CMMI  models  describe  best  practices  that  organizations  have  found  to  be 
productive  and  useful  to  achieving  their  business  objectives.  Regardless  of 
your  organization,  you  must  use  professional  judgment  when  interpreting 
CMMI  best  practices  for  your  situation,  needs,  and  business  objectives. 

This  use  of  judgment  is  reinforced  when  you  see  words  such  as  “adequate,” 
“appropriate,”  or  “as  needed”  in  a  goal  or  practice.  These  words  are  used 
for  activities  that  may  not  be  equally  relevant  in  all  situations.  Interpret  these 
goals  and  practices  in  ways  that  work  for  your  organization. 

Although  process  areas  depict  the  characteristics  of  an  organization 
committed  to  process  improvement,  you  must  interpret  the  process  areas 
using  an  in-depth  knowledge  of  CMMI,  your  organization,  the  business 
environment,  and  the  specific  circumstances  involved. 

As  you  begin  using  a  CMMI  model  to  improve  your  organization’s 
processes,  map  your  real  world  processes  to  CMMI  process  areas.  This 
mapping  enables  you  to  initially  judge  and  later  track  your  organization’s 
level  of  conformance  to  the  CMMI  model  you  are  using  and  to  identify 
opportunities  for  improvement. 

To  interpret  practices,  it  is  important  to  consider  the  overall  context  in  which 
these  practices  are  used  and  to  determine  how  well  the  practices  satisfy  the 
goals  of  a  process  area  in  that  context.  CMMI  models  do  not  prescribe  nor 
imply  processes  that  are  right  for  any  organization  or  project.  Instead, 

CMMI  describes  minimal  criteria  necessary  to  plan  and  implement 
processes  selected  by  the  organization  for  improvement  based  on  business 
objectives. 

CMMI  practices  purposely  use  nonspecific  phrases  such  as  “relevant 
stakeholders,”  “as  appropriate,”  and  “as  necessary”  to  accommodate  the 
needs  of  different  organizations  and  projects.  The  specific  needs  of  a 
project  can  also  differ  at  various  points  in  its  life. 
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Using  CMMI  Appraisals 


Many  organizations  find  value  in  measuring  their  progress  by  conducting  an 
appraisal  and  earning  a  maturity  level  rating  or  a  capability  level 
achievement  profile.  These  types  of  appraisals  are  typically  conducted  for 
one  or  more  of  the  following  reasons: 

•  To  determine  how  well  the  organization’s  processes  compare  to  CMMI 
best  practices  and  identify  areas  where  improvement  can  be  made 

•  To  inform  external  customers  and  suppliers  about  how  well  the 
organization’s  processes  compare  to  CMMI  best  practices 

•  To  meet  the  contractual  requirements  of  one  or  more  customers 

Appraisals  of  organizations  using  a  CMMI  model  must  conform  to  the 
requirements  defined  in  the  Appraisal  Requirements  for  CMMI  (ARC)  [SEI 
2011b]  document.  Appraisals  focus  on  identifying  improvement 
opportunities  and  comparing  the  organization’s  processes  to  CMMI  best 
practices. 

Appraisal  teams  use  a  CMMI  model  and  ARC-conformant  appraisal  method 
to  guide  their  evaluation  of  the  organization  and  their  reporting  of 
conclusions.  The  appraisal  results  are  used  (e.g.,  by  a  process  group)  to 
plan  improvements  for  the  organization. 


Appraisal  Requirements  for  CMMI 


The  Appraisal  Requirements  for  CMMI  (ARC)  document  describes  the 
requirements  for  several  types  of  appraisals.  A  full  benchmarking  appraisal 
is  defined  as  a  Class  A  appraisal  method.  Less  formal  methods  are  defined 
as  Class  B  or  Class  C  methods.  The  ARC  document  was  designed  to  help 
improve  consistency  across  appraisal  methods  and  to  help  appraisal 
method  developers,  sponsors,  and  users  understand  the  tradeoffs 
associated  with  various  methods. 

Depending  on  the  purpose  of  the  appraisal  and  the  nature  of  the 
circumstances,  one  class  may  be  preferred  over  the  others.  Sometimes  self 
assessments,  initial  appraisals,  quick-look  or  mini  appraisals,  or  external 
appraisals  are  appropriate;  at  other  times  a  formal  benchmarking  appraisal 
is  appropriate. 

A  particular  appraisal  method  is  declared  an  ARC  Class  A,  B,  or  C 
appraisal  method  based  on  the  sets  of  ARC  requirements  that  the  method 
developer  addressed  when  designing  the  method. 

More  information  about  the  ARC  is  available  on  the  SEI  website  at 
http://www.sei.cmu.edu/cmmi/tools/appraisals/. 
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SCAMPI  Appraisal  Methods 


The  SCAMPI  A  appraisal  method  is  the  generally  accepted  method  used  for 
conducting  ARC  Class  A  appraisals  using  CMMI  models.  The  SCAMPI  A 
Method  Definition  Document  (MDD)  defines  rules  for  ensuring  the 
consistency  of  SCAMPI  A  appraisal  ratings  [SEI  2011a].  For  benchmarking 
against  other  organizations,  appraisals  must  ensure  consistent  ratings.  The 
achievement  of  a  specific  maturity  level  or  the  satisfaction  of  a  process  area 
must  mean  the  same  thing  for  different  appraised  organizations. 

The  SCAMPI  family  of  appraisals  includes  Class  A,  B,  and  C  appraisal 
methods.  The  SCAMPI  A  appraisal  method  is  the  officially  recognized  and 
most  rigorous  method.  It  is  the  only  method  that  can  result  in  benchmark 
quality  ratings.  SCAMPI  B  and  C  appraisal  methods  provide  organizations 
with  improvement  information  that  is  less  formal  than  the  results  of  a 
SCAMPI  A  appraisal,  but  nonetheless  helps  the  organization  to  identify 
improvement  opportunities. 

More  information  about  SCAMPI  methods  is  available  on  the  SEI  website  at 
http://www.sei.cmu.edu/cmmi/tools/appraisals/. 


Appraisal  Considerations 


Choices  that  affect  a  CMMI-based  appraisal  include  the  following: 

•  CMMI  model 

•  Appraisal  scope,  including  the  organizational  unit  to  be  appraised,  the 
CMMI  process  areas  to  be  investigated,  and  the  maturity  level  or 
capability  levels  to  be  appraised 

•  Appraisal  method 

•  Appraisal  team  leader  and  team  members 

•  Appraisal  participants  selected  from  the  appraisal  entities  to  be 
interviewed 

•  Appraisal  outputs  (e.g.,  ratings,  instantiation  specific  findings) 

•  Appraisal  constraints  (e.g.,  time  spent  on  site) 

The  SCAMPI  MDD  allows  the  selection  of  predefined  options  for  use  in  an 
appraisal.  These  appraisal  options  are  designed  to  help  organizations  align 
CMMI  with  their  business  needs  and  objectives. 

CMMI  appraisal  plans  and  results  should  always  include  a  description  of  the 
appraisal  options,  model  scope,  and  organizational  scope  selected.  This 
documentation  confirms  whether  an  appraisal  meets  the  requirements  for 
benchmarking. 

For  organizations  that  wish  to  appraise  multiple  functions  or  groups,  the 
integrated  approach  of  CMMI  enables  some  economy  of  scale  in  model  and 
appraisal  training.  One  appraisal  method  can  provide  separate  or  combined 
results  for  multiple  functions. 
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The  following  appraisal  principles  for  CMMI  are  the  same  as  those 
principles  used  in  appraisals  for  other  process  improvement  models: 

•  Senior  management  sponsorship11 

•  A  focus  on  the  organization’s  business  objectives 

•  Confidentiality  for  interviewees 

•  Use  of  a  documented  appraisal  method 

•  Use  of  a  process  reference  model  (e.g.,  a  CMMI  model) 

•  A  collaborative  team  approach 

•  A  focus  on  actions  for  process  improvement 


CMMI  Related  Training 


Whether  your  organization  is  new  to  process  improvement  or  is  already 
familiar  with  process  improvement  models,  training  is  a  key  element  in  the 
ability  of  organizations  to  adopt  CMMI.  An  initial  set  of  courses  is  provided 
by  the  SEI  and  its  Partner  Network,  but  your  organization  may  wish  to 
supplement  these  courses  with  its  own  instruction.  This  approach  allows 
your  organization  to  focus  on  areas  that  provide  the  greatest  business 
value. 

The  SEI  and  its  Partner  Network  offer  an  introductory  course  that  provides 
a  basic  overview  of  CMMI  for  Acquisition.  The  SEI  also  offers  advanced 
training  to  those  who  plan  to  become  more  deeply  involved  in  CMMI 
adoption  or  appraisal — for  example,  those  who  will  guide  improvement  as 
part  of  a  process  group,  those  who  will  lead  SCAMPI  appraisals,  and  those 
who  will  teach  the  introductory  course. 

Current  information  about  CMMI  related  training  is  available  on  the  SEI 
website  at  http://www.sei.cmu.edu/traininq/. 


11  Experience  has  shown  that  the  most  critical  factor  influencing  successful  process  improvement  and  appraisals  is  senior 
management  sponsorship. 
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Part  Two: 

Generic  Goals  and  Generic  Practices, 
and  the  Process  Areas 
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GENERIC  GOALS  AND  GENERIC  PRACTICES 


Overview 


This  section  describes  in  detail  all  the  generic  goals  and  generic  practices 
of  CMMI — model  components  that  directly  address  process 
institutionalization.  As  you  address  each  process  area,  refer  to  this  section 
for  the  details  of  all  generic  practices. 

Generic  practice  elaborations  appear  after  generic  practices  to  provide 
guidance  on  how  the  generic  practice  can  be  applied  uniquely  to  process 
areas. 


Process  Institutionalization 


Institutionalization  is  an  important  concept  in  process  improvement.  When 
mentioned  in  the  generic  goal  and  generic  practice  descriptions, 
institutionalization  implies  that  the  process  is  ingrained  in  the  way  the  work 
is  performed  and  there  is  commitment  and  consistency  to  performing  (i.e., 
executing)  the  process. 

An  institutionalized  process  is  more  likely  to  be  retained  during  times  of 
stress.  When  the  requirements  and  objectives  for  the  process  change, 
however,  the  implementation  of  the  process  may  also  need  to  change  to 
ensure  that  it  remains  effective.  The  generic  practices  describe  activities 
that  address  these  aspects  of  institutionalization. 

The  degree  of  institutionalization  is  embodied  in  the  generic  goals  and 
expressed  in  the  names  of  the  processes  associated  with  each  goal  as 
indicated  in  Table  6.1 . 


Table  6. 1  Generic  Goals  and  Process  Names 


Generic  Goal 

Progression  of  Processes 

GG  1 

Performed  process 

GG  2 

Managed  process 

GG  3 

Defined  process 

The  progression  of  process  institutionalization  is  characterized  in  the 
following  descriptions  of  each  process. 

Performed  Process 

A  performed  process  is  a  process  that  accomplishes  the  work  necessary  to 
satisfy  the  specific  goals  of  a  process  area. 
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Managed  Process _ 

A  managed  process  is  a  performed  process  that  is  planned  and  executed  in 
accordance  with  policy;  employs  skilled  people  having  adequate  resources 
to  produce  controlled  outputs;  involves  relevant  stakeholders;  is  monitored, 
controlled,  and  reviewed;  and  is  evaluated  for  adherence  to  its  process 
description. 

The  process  can  be  instantiated  by  a  project,  group,  or  organizational 
function.  Management  of  the  process  is  concerned  with  institutionalization 
and  the  achievement  of  other  specific  objectives  established  for  the 
process,  such  as  cost,  schedule,  and  quality  objectives.  The  control 
provided  by  a  managed  process  helps  to  ensure  that  the  established 
process  is  retained  during  times  of  stress. 

The  requirements  and  objectives  for  the  process  are  established  by  the 
organization.  The  status  of  the  work  products  and  services  are  visible  to 
management  at  defined  points  (e.g.,  at  major  milestones,  on  completion  of 
major  tasks).  Commitments  are  established  among  those  who  perform  the 
work  and  the  relevant  stakeholders  and  are  revised  as  necessary.  Work 
products  are  reviewed  with  relevant  stakeholders  and  are  controlled.  The 
work  products  and  services  satisfy  their  specified  requirements. 

A  critical  distinction  between  a  performed  process  and  a  managed  process 
is  the  extent  to  which  the  process  is  managed.  A  managed  process  is 
planned  (the  plan  can  be  part  of  a  more  encompassing  plan)  and  the 
execution  of  the  process  is  managed  against  the  plan.  Corrective  actions 
are  taken  when  the  actual  results  and  execution  deviate  significantly  from 
the  plan.  A  managed  process  achieves  the  objectives  of  the  plan  and  is 
institutionalized  for  consistent  execution. 

Defined  Process 

A  defined  process  is  a  managed  process  that  is  tailored  from  the 
organization’s  set  of  standard  processes  according  to  the  organization’s 
tailoring  guidelines;  has  a  maintained  process  description;  and  contributes 
process  related  experiences  to  the  organizational  process  assets. 

Organizational  process  assets  are  artifacts  that  relate  to  describing, 
implementing,  and  improving  processes.  These  artifacts  are  assets 
because  they  are  developed  or  acquired  to  meet  the  business  objectives  of 
the  organization  and  they  represent  investments  by  the  organization  that 
are  expected  to  provide  current  and  future  business  value. 

The  organization’s  set  of  standard  processes,  which  are  the  basis  of  the 
defined  process,  are  established  and  improved  over  time.  Standard 
processes  describe  the  fundamental  process  elements  that  are  expected  in 
the  defined  processes.  Standard  processes  also  describe  the  relationships 
(e.g.,  the  ordering,  the  interfaces)  among  these  process  elements.  The 
organization-level  infrastructure  to  support  current  and  future  use  of  the 
organization’s  set  of  standard  processes  is  established  and  improved  over 
time.  (See  the  definition  of  “standard  process”  in  the  glossary.) 


60 


Generic  Goals  and  Generic  Practices 


CMMI  for  Acquisition,  Version  1.3 


A  project’s  defined  process  provides  a  basis  for  planning,  performing,  and 
improving  the  project’s  tasks  and  activities.  A  project  can  have  more  than 
one  defined  process  (e.g.,  one  for  developing  the  product  and  another  for 
testing  the  product). 

A  defined  process  clearly  states  the  following: 

•  Purpose 

•  Inputs 

•  Entry  criteria 

•  Activities 

•  Roles 

•  Measures 

•  Verification  steps 

•  Outputs 

•  Exit  criteria 

A  critical  distinction  between  a  managed  process  and  a  defined  process  is 
the  scope  of  application  of  the  process  descriptions,  standards,  and 
procedures.  For  a  managed  process,  the  process  descriptions,  standards, 
and  procedures  are  applicable  to  a  particular  project,  group,  or 
organizational  function.  As  a  result,  the  managed  processes  of  two  projects 
in  one  organization  can  be  different. 

Another  critical  distinction  is  that  a  defined  process  is  described  in  more 
detail  and  is  performed  more  rigorously  than  a  managed  process.  This 
distinction  means  that  improvement  information  is  easier  to  understand, 
analyze,  and  use.  Finally,  management  of  the  defined  process  is  based  on 
the  additional  insight  provided  by  an  understanding  of  the  interrelationships 
of  the  process  activities  and  detailed  measures  of  the  process,  its  work 
products,  and  its  services. 

Relationships  Among  Processes 

The  generic  goals  evolve  so  that  each  goal  provides  a  foundation  for  the 
next.  Therefore,  the  following  conclusions  can  be  made: 

•  A  managed  process  is  a  performed  process. 

•  A  defined  process  is  a  managed  process. 

Thus,  applied  sequentially  and  in  order,  the  generic  goals  describe  a 
process  that  is  increasingly  institutionalized  from  a  performed  process  to  a 
defined  process. 

Achieving  GG  1  for  a  process  area  is  equivalent  to  saying  you  achieve  the 
specific  goals  of  the  process  area. 

Achieving  GG  2  for  a  process  area  is  equivalent  to  saying  you  manage  the 
execution  of  processes  associated  with  the  process  area.  There  is  a  policy 
that  indicates  you  will  perform  the  process.  There  is  a  plan  for  performing  it. 
There  are  resources  provided,  responsibilities  assigned,  training  on  how  to 
perform  it,  selected  work  products  from  performing  the  process  are 
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controlled,  and  so  on.  In  other  words,  the  process  is  planned  and  monitored 
just  like  any  project  or  support  activity. 

Achieving  GG  3  for  a  process  area  is  equivalent  to  saying  that  an 
organizational  standard  process  exists  that  can  be  tailored  to  result  in  the 
process  you  will  use.  Tailoring  might  result  in  making  no  changes  to  the 
standard  process.  In  other  words,  the  process  used  and  the  standard 
process  can  be  identical.  Using  the  standard  process  “as  is”  is  tailoring 
because  the  choice  is  made  that  no  modification  is  required. 

Each  process  area  describes  multiple  activities,  some  of  which  are 
repeatedly  performed.  You  may  need  to  tailor  the  way  one  of  these 
activities  is  performed  to  account  for  new  capabilities  or  circumstances.  For 
example,  you  may  have  a  standard  for  developing  or  obtaining 
organizational  training  that  does  not  consider  web-based  training.  When 
preparing  to  develop  or  obtain  a  web-based  course,  you  may  need  to  tailor 
the  standard  process  to  account  for  the  particular  challenges  and  benefits 
of  web-based  training. 


Generic  Goals  and  Generic  Practices 


This  section  describes  all  of  the  generic  goals  and  generic  practices,  as  well 
as  their  associated  subpractices,  notes,  examples,  and  references.  The 
generic  goals  are  organized  in  numerical  order,  GG  1  through  GG  3.  The 
generic  practices  are  also  organized  in  numerical  order  under  the  generic 
goal  they  support. 

GG  1 _ Achieve  Specific  Goals _ 

The  specific  goals  of  the  process  area  are  supported  by  the  process  by 
transforming  identifiable  input  work  products  into  identifiable  output  work 
products. 


GP1.1  Perform  Specific  Practices 

Perform  the  specific  practices  of  the  process  area  to  develop  work 
products  and  provide  services  to  achieve  the  specific  goals  of  the 
process  area. 

The  purpose  of  this  generic  practice  is  to  produce  the  work  products  and 
deliver  the  services  that  are  expected  by  performing  (i.e.,  executing)  the 
process.  These  practices  can  be  done  informally  without  following  a 
documented  process  description  or  plan.  The  rigor  with  which  these 
practices  are  performed  depends  on  the  individuals  managing  and 
performing  the  work  and  can  vary  considerably. 
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GG  2 _ Institutionalize  a  Managed  Process _ 

The  process  is  institutionalized  as  a  managed  process. 

GP  2.1  Establish  an  Organizational  Policy 

Establish  and  maintain  an  organizational  policy  for  planning  and 
performing  the  process. 

The  purpose  of  this  generic  practice  is  to  define  the  organizational 
expectations  for  the  process  and  make  these  expectations  visible  to  those 
members  of  the  organization  who  are  affected.  In  general,  senior 
management  is  responsible  for  establishing  and  communicating  guiding 
principles,  direction,  and  expectations  for  the  organization. 

Not  all  direction  from  senior  management  will  bear  the  label  “policy.”  The 
existence  of  appropriate  organizational  direction  is  the  expectation  of  this 
generic  practice,  regardless  of  what  it  is  called  or  how  it  is  imparted. 

Elaboration  for  all  PAs 

This  policy  establishes  organizational  expectations  for  planning  and 
performing  the  process,  including  not  only  the  elements  of  the  process 
addressed  directly  by  the  acquirer  but  also  the  interactions  between  the 
acquirer  and  suppliers. 

GP  2.2  Plan  the  Process 

Establish  and  maintain  the  plan  for  performing  the  process. 

The  purpose  of  this  generic  practice  is  to  determine  what  is  needed  to 
perform  the  process  and  to  achieve  the  established  objectives,  to  prepare  a 
plan  for  performing  the  process,  to  prepare  a  process  description,  and  to 
get  agreement  on  the  plan  from  relevant  stakeholders. 

The  practical  implications  of  applying  a  generic  practice  vary  for  each 
process  area. 

I  For  example,  the  planning  described  by  this  generic  practice  as  applied  to  the  Project 
:  Monitoring  and  Control  process  area  can  be  carried  out  in  full  by  the  processes  associated 
■  with  the  Project  Planning  process  area.  However,  this  generic  practice,  when  applied  to  the 
i  Project  Planning  process  area,  sets  an  expectation  that  the  project  planning  process  itself 
j  be  planned. 


Therefore,  this  generic  practice  can  either  reinforce  expectations  set 
elsewhere  in  CMMI  or  set  new  expectations  that  should  be  addressed. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
establishing  and  maintaining  plans  that  define  project  activities. 

Establishing  a  plan  includes  documenting  the  plan  and  a  process 
description.  Maintaining  the  plan  includes  updating  it  to  reflect  corrective 
actions  or  changes  in  requirements  or  objectives. 
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The  plan  for  performing  the  process  typically  includes  the  following: 

•  Process  description 

•  Standards  and  requirements  for  the  work  products  and  services  of  the  process 

•  Specific  objectives  for  the  execution  of  the  process  and  its  results  (e.g.,  quality,  time 
scale,  cycle  time,  use  of  resources) 

•  Dependencies  among  the  activities,  work  products,  and  services  of  the  process 

•  Resources  (e.g.,  funding,  people,  tools)  needed  to  perform  the  process 

•  Assignment  of  responsibility  and  authority 

•  Training  needed  for  performing  and  supporting  the  process 

•  Work  products  to  be  controlled  and  the  level  of  control  to  be  applied 

•  Measurement  requirements  to  provide  insight  into  the  execution  of  the  process,  its  work 
products,  and  its  services 

•  Involvement  of  relevant  stakeholders 

•  Activities  for  monitoring  and  controlling  the  process 

•  Objective  evaluation  activities  of  the  process 

•  Management  review  activities  for  the  process  and  the  work  products 


Subpractices 

1 .  Define  and  document  the  plan  for  performing  the  process. 

This  plan  can  be  a  stand-alone  document,  embedded  in  a  more  comprehensive 
document,  or  distributed  among  multiple  documents.  In  the  case  of  the  plan  being 
distributed  among  multiple  documents,  ensure  that  a  coherent  picture  of  who  does 
what  is  preserved.  Documents  can  be  hardcopy  or  softcopy. 

2.  Define  and  document  the  process  description. 

The  process  description,  which  includes  relevant  standards  and  procedures,  can  be 
included  as  part  of  the  plan  for  performing  the  process  or  can  be  included  in  the  plan 
by  reference. 

3.  Review  the  plan  with  relevant  stakeholders  and  get  their  agreement. 

This  review  of  the  plan  includes  reviewing  that  the  planned  process  satisfies  the 
applicable  policies,  plans,  requirements,  and  standards  to  provide  assurance  to 
relevant  stakeholders. 

4.  Revise  the  plan  as  necessary. 

GP  2.3  Provide  Resources 

Provide  adequate  resources  for  performing  the  process, 
developing  the  work  products,  and  providing  the  services  of  the 
process. 

The  purpose  of  this  generic  practice  is  to  ensure  that  the  resources 
necessary  to  perform  the  process  as  defined  by  the  plan  are  available  when 
they  are  needed.  Resources  include  adequate  funding,  appropriate  physical 
facilities,  skilled  people,  and  appropriate  tools. 
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The  interpretation  of  the  term  “adequate”  depends  on  many  factors  and  can 
change  overtime.  Inadequate  resources  may  be  addressed  by  increasing 
resources  or  by  removing  requirements,  constraints,  and  commitments. 

GP  2.4  Assign  Responsibility 

Assign  responsibility  and  authority  for  performing  the  process, 
developing  the  work  products,  and  providing  the  services  of  the 
process. 

The  purpose  of  this  generic  practice  is  to  ensure  that  there  is  accountability 
for  performing  the  process  and  achieving  the  specified  results  throughout 
the  life  of  the  process.  The  people  assigned  must  have  the  appropriate 
authority  to  perform  the  assigned  responsibilities. 

Responsibility  can  be  assigned  using  detailed  job  descriptions  or  in  living 
documents,  such  as  the  plan  for  performing  the  process.  Dynamic 
assignment  of  responsibility  is  another  legitimate  way  to  implement  this 
generic  practice,  as  long  as  the  assignment  and  acceptance  of 
responsibility  are  ensured  throughout  the  life  of  the  process. 

Subpractices 

1 .  Assign  overall  responsibility  and  authority  for  performing  the  process. 

2.  Assign  responsibility  and  authority  for  performing  the  specific  tasks  of 
the  process. 

3.  Confirm  that  the  people  assigned  to  the  responsibilities  and  authorities 
understand  and  accept  them. 

GP  2.5  Train  People 

Train  the  people  performing  or  supporting  the  process  as  needed. 

The  purpose  of  this  generic  practice  is  to  ensure  that  people  have  the 
necessary  skills  and  expertise  to  perform  or  support  the  process. 

Appropriate  training  is  provided  to  those  who  will  be  performing  the  work. 
Overview  training  is  provided  to  orient  people  who  interact  with  those  who 
perform  the  work. 

r - 

|  Examples  of  methods  for  providing  training  include  self  study;  self-directed  training;  self- 
:  paced,  programmed  instruction;  formalized  on-the-job  training;  mentoring;  and  formal  and 
j  classroom  training. 


Training  supports  the  successful  execution  of  the  process  by  establishing  a 
common  understanding  of  the  process  and  by  imparting  the  skills  and 
knowledge  needed  to  perform  the  process. 

The  organization  should  conduct  a  training  needs  analysis  to  understand  its 
process  training  needs  at  both  the  organization  and  project  levels.  Then, 
appropriate  training  vehicles  can  be  identified  and  provided  to  minimize 
process  execution  related  risks. 


Generic  Goals  and  Generic  Practices 


65 


CMMI  for  Acquisition,  Version  1.3 


Refer  to  the  Organizational  Training  process  area  for  more  information 
about  developing  skills  and  knowledge  of  people  so  they  can  perform  their 
roles  effectively  and  efficiently. 

Elaboration  for  all  PAs 

Determining  appropriate  skills  for  people  performing  roles  in  the  acquisition 
process  can  serve  as  a  basis  for  identifying  relevant  training  for  each  role. 

i - 

|  Examples  of  acquisition  training  include  the  following: 

j  •  Regulations  and  business  practices  related  to  negotiating  and  working  with  suppliers 
|  •  Acquisition  planning  and  preparation 
:  •  COTS  products  acquisition 

i  •  Supplier  evaluation  and  selection 

i  •  Negotiation  and  conflict  resolution 

:  •  Supplier  management 

j  •  Testing  and  ensuring  the  transition  of  acquired  products 
|  •  Receiving,  storing,  using,  and  maintaining  acquired  products 


GP  2.6  Control  Work  Products 

Place  selected  work  products  of  the  process  under  appropriate 
levels  of  control. 

The  purpose  of  this  generic  practice  is  to  establish  and  maintain  the 
integrity  of  the  selected  work  products  of  the  process  (or  their  descriptions) 
throughout  their  useful  life. 

The  selected  work  products  are  specifically  identified  in  the  plan  for 
performing  the  process,  along  with  a  specification  of  the  appropriate  level  of 
control. 

Different  levels  of  control  are  appropriate  for  different  work  products  and  for 
different  points  in  time.  For  some  work  products,  it  may  be  sufficient  to 
maintain  version  control  so  that  the  version  of  the  work  product  in  use  at  a 
given  time,  past  or  present,  is  known  and  changes  are  incorporated  in  a 
controlled  manner.  Version  control  is  usually  under  the  sole  control  of  the 
work  product  owner  (which  can  be  an  individual,  group,  or  team). 

Sometimes,  it  can  be  critical  that  work  products  be  placed  under  formal  or 
baseline  configuration  management.  This  type  of  control  includes  defining 
and  establishing  baselines  at  predetermined  points.  These  baselines  are 
formally  reviewed  and  approved,  and  serve  as  the  basis  for  further 
development  of  the  designated  work  products. 

Refer  to  the  Configuration  Management  process  area  for  more  information 
about  establishing  and  maintaining  the  integrity  of  work  products  using 
configuration  identification,  configuration  control,  configuration  status 
accounting,  and  configuration  audits. 
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Additional  levels  of  control  between  version  control  and  formal  configuration 
management  are  possible.  An  identified  work  product  can  be  under  various 
levels  of  control  at  different  points  in  time. 

Elaboration  for  all  PAs 

The  acquirer  is  responsible  for  establishing  and  maintaining  baselines  and 
ensuring  designated  acquirer  work  products  and  supplier  deliverables  are 
placed  under  appropriate  levels  of  control. 

I  Examples  of  acquirer  work  products  and  supplier  deliverables  placed  under  control  include 
:  the  following: 

i  •  Project  plans 

i  •  Solicitation  packages 

j  •  Measures 

:  •  Product  documentation 


GP  2.7  Identify  and  Involve  Relevant  Stakeholders 

Identify  and  involve  the  relevant  stakeholders  of  the  process  as 
planned. 

The  purpose  of  this  generic  practice  is  to  establish  and  maintain  the 
expected  involvement  of  relevant  stakeholders  during  the  execution  of  the 
process. 

Involve  relevant  stakeholders  as  described  in  an  appropriate  plan  for 
stakeholder  involvement.  Involve  stakeholders  appropriately  in  activities 
such  as  the  following: 

•  Planning 

•  Decisions 

•  Commitments 

•  Communications 

•  Coordination 

•  Reviews 

•  Appraisals 

•  Requirements  definitions 

•  Resolution  of  problems  and  issues 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
planning  stakeholder  involvement. 

The  objective  of  planning  stakeholder  involvement  is  to  ensure  that 
interactions  necessary  to  the  process  are  accomplished,  while  not  allowing 
excessive  numbers  of  affected  groups  and  individuals  to  impede  process 
execution. 
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|  Examples  of  stakeholders  that  might  serve  as  relevant  stakeholders  for  specific  tasks, 
i  depending  on  context,  include  individuals,  teams,  management,  customers,  suppliers,  end 
:  users,  operations  and  support  staff,  other  projects,  and  government  regulators. 


Subpractices 

1 .  Identify  stakeholders  relevant  to  this  process  and  their  appropriate 
involvement. 

Relevant  stakeholders  are  identified  among  the  suppliers  of  inputs  to,  the  users  of 
outputs  from,  and  the  performers  of  the  activities  in  the  process.  Once  the  relevant 
stakeholders  are  identified,  the  appropriate  level  of  their  involvement  in  process 
activities  is  planned. 

2.  Share  these  identifications  with  project  planners  or  other  planners  as 
appropriate. 

3.  Involve  relevant  stakeholders  as  planned. 

GP  2.8  Monitor  and  Control  the  Process 

Monitor  and  control  the  process  against  the  plan  for  performing 
the  process  and  take  appropriate  corrective  action. 

The  purpose  of  this  generic  practice  is  to  perform  the  direct  day-to-day 
monitoring  and  controlling  of  the  process.  Appropriate  visibility  into  the 
process  is  maintained  so  that  appropriate  corrective  action  can  be  taken 
when  necessary.  Monitoring  and  controlling  the  process  can  involve 
measuring  appropriate  attributes  of  the  process  or  work  products  produced 
by  the  process. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  developing  and  sustaining  a  measurement  capability  used  to  support 
management  information  needs. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  providing  an  understanding  of  the  project’s  progress  so 
that  appropriate  corrective  actions  can  be  taken  when  the  project’s 
performance  deviates  significantly  from  the  plan. 

Subpractices 

1 .  Evaluate  actual  progress  and  performance  against  the  plan  for 
performing  the  process. 

The  evaluations  are  of  the  process,  its  work  products,  and  its  services. 

2.  Review  accomplishments  and  results  of  the  process  against  the  plan 
for  performing  the  process. 

3.  Review  activities,  status,  and  results  of  the  process  with  the  immediate 
level  of  management  responsible  for  the  process  and  identify  issues. 

These  reviews  are  intended  to  provide  the  immediate  level  of  management  with 
appropriate  visibility  into  the  process  based  on  the  day-to-day  monitoring  and 
controlling  of  the  process,  and  are  supplemented  by  periodic  and  event-driven  reviews 
with  higher  level  management  as  described  in  GP  2.10. 
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4.  Identify  and  evaluate  the  effects  of  significant  deviations  from  the  plan 
for  performing  the  process. 

5.  Identify  problems  in  the  plan  for  performing  the  process  and  in  the 
execution  of  the  process. 

6.  Take  corrective  action  when  requirements  and  objectives  are  not  being 
satisfied,  when  issues  are  identified,  or  when  progress  differs 
significantly  from  the  plan  for  performing  the  process. 

Inherent  risks  should  be  considered  before  any  corrective  action  is  taken. 

j  Corrective  action  can  include  the  following: 

i  •  Taking  remedial  action  to  repair  defective  work  products  or  services 

i  •  Changing  the  plan  for  performing  the  process 

i  •  Adjusting  resources,  including  people,  tools,  and  other  resources 

i  •  Negotiating  changes  to  the  established  commitments 

:  •  Securing  change  to  the  requirements  and  objectives  that  must  be  satisfied 

:  •  Terminating  the  effort 

7.  Track  corrective  action  to  closure. 

Elaboration  for  all  PAs 

The  project  collects  and  analyzes  measurements  from  the  acquirer  and 
from  the  supplier  to  effectively  monitor  and  control  the  project. 

OPF  Elaboration 

r - - 

|  Examples  of  measures  and  work  products  used  in  monitoring  and  controlling  include  the 
:  following: 

:  •  Number  of  process  improvement  proposals  submitted,  accepted,  or  implemented 
i  •  CMMI  maturity  level  or  capability  level  earned 
i  •  Schedule  for  deployment  of  an  organizational  process  asset 
j  •  Percentage  of  projects  using  the  current  organization’s  set  of  standard  processes  (or 
i  tailored  version  of  the  current  set) 

i  •  Issue  trends  associated  with  implementing  the  organization’s  set  of  standard  processes 
j  (i.e.,  number  of  issues  identified,  number  closed) 

|  •  Progress  toward  achievement  of  process  needs  and  objectives 


GP  2.9  Objectively  Evaluate  Adherence 

Objectively  evaluate  adherence  of  the  process  and  selected  work 
products  against  the  process  description,  standards,  and 
procedures,  and  address  noncompliance. 

The  purpose  of  this  generic  practice  is  to  provide  credible  assurance  that 
the  process  and  selected  work  products  are  implemented  as  planned  and 
adhere  to  the  process  description,  standards,  and  procedures.  (See  the 
definition  of  “objectively  evaluate”  in  the  glossary.) 
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Refer  to  the  Process  and  Product  Quality  Assurance  process  area  for  more 
information  about  objectively  evaluating  processes  and  work  products. 

People  not  directly  responsible  for  managing  or  performing  the  activities  of 
the  process  typically  evaluate  adherence.  In  many  cases,  adherence  is 
evaluated  by  people  in  the  organization,  but  external  to  the  process  or 
project,  or  by  people  external  to  the  organization.  As  a  result,  credible 
assurance  of  adherence  can  be  provided  even  during  times  when  the 
process  is  under  stress  (e.g.,  when  the  effort  is  behind  schedule,  when  the 
effort  is  over  budget). 

GP  2.10  Review  Status  with  Higher  Level  Management 

Review  the  activities,  status,  and  results  of  the  process  with  higher 
level  management  and  resolve  issues. 

The  purpose  of  this  generic  practice  is  to  provide  higher  level  management 
with  the  appropriate  visibility  into  the  process. 

Higher  level  management  includes  those  levels  of  management  in  the 
organization  above  the  immediate  level  of  management  responsible  for  the 
process.  In  particular,  higher  level  management  can  include  senior 
management.  These  reviews  are  for  managers  who  provide  the  policy  and 
overall  guidance  for  the  process  and  not  for  those  who  perform  the  direct 
day-to-day  monitoring  and  controlling  of  the  process. 

Different  managers  have  different  needs  for  information  about  the  process. 
These  reviews  help  ensure  that  informed  decisions  on  the  planning  and 
performing  of  the  process  can  be  made.  Therefore,  these  reviews  are 
expected  to  be  both  periodic  and  event  driven. 

Proposed  changes  to  commitments  to  be  made  external  to  the  organization 
(e.g.,  changes  to  supplier  agreements)  are  typically  reviewed  with  higher 
level  management  to  obtain  their  agreement  with  the  proposed  changes. 

GG  3  Institutionalize  a  Defined  Process 

The  process  is  institutionalized  as  a  defined  process. 

GP  3.1  Establish  a  Defined  Process 

Establish  and  maintain  the  description  of  a  defined  process. 

The  purpose  of  this  generic  practice  is  to  establish  and  maintain  a 
description  of  the  process  that  is  tailored  from  the  organization’s  set  of 
standard  processes  to  address  the  needs  of  a  specific  instantiation.  The 
organization  should  have  standard  processes  that  cover  the  process  area, 
as  well  as  have  guidelines  for  tailoring  these  standard  processes  to  meet 
the  needs  of  a  project  or  organizational  function.  With  a  defined  process, 
variability  in  how  the  processes  are  performed  across  the  organization  is 
reduced  and  process  assets,  data,  and  learning  can  be  effectively  shared. 

Refer  to  the  Integrated  Project  Management  process  area  for  more 
information  about  establishing  the  project’s  defined  process. 
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Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  standard  processes  and  establishing  tailoring 
criteria  and  guidelines. 

The  descriptions  of  the  defined  processes  provide  the  basis  for  planning, 
performing,  and  managing  the  activities,  work  products,  and  services 
associated  with  the  process. 

Subpractices 

1 .  Select  from  the  organization’s  set  of  standard  processes  those 
processes  that  cover  the  process  area  and  best  meet  the  needs  of  the 
project  or  organizational  function. 

2.  Establish  the  defined  process  by  tailoring  the  selected  processes 
according  to  the  organization’s  tailoring  guidelines. 

3.  Ensure  that  the  organization’s  process  objectives  are  appropriately 
addressed  in  the  defined  process. 

4.  Document  the  defined  process  and  the  records  of  the  tailoring. 

5.  Revise  the  description  of  the  defined  process  as  necessary. 

GP  3.2  Collect  Process  Related  Experiences 

Collect  process  related  experiences  derived  from  planning  and 
performing  the  process  to  support  the  future  use  and  improvement 
of  the  organization’s  processes  and  process  assets. 

The  purpose  of  this  generic  practice  is  to  collect  process  related 
experiences,  including  information  and  artifacts  derived  from  planning  and 
performing  the  process.  Examples  of  process  related  experiences  include 
work  products,  measures,  measurement  results,  lessons  learned,  and 
process  improvement  suggestions.  The  information  and  artifacts  are 
collected  so  that  they  can  be  included  in  the  organizational  process  assets 
and  made  available  to  those  who  are  (or  who  will  be)  planning  and 
performing  the  same  or  similar  processes.  The  information  and  artifacts  are 
stored  in  the  organization’s  measurement  repository  and  the  organization’s 
process  asset  library. 

:  Examples  of  relevant  information  include  the  effort  expended  for  the  various  activities, 

I  defects  injected  or  removed  in  a  particular  activity,  and  lessons  learned. 


Refer  to  the  Integrated  Project  Management  process  area  for  more 
information  about  contributing  to  organizational  process  assets. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

Subpractices 

1 .  Store  process  and  product  measures  in  the  organization’s 
measurement  repository. 

The  process  and  product  measures  are  primarily  those  measures  that  are  defined  in 
the  common  set  of  measures  for  the  organization’s  set  of  standard  processes. 
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2.  Submit  documentation  for  inclusion  in  the  organization’s  process  asset 
library. 

3.  Document  lessons  learned  from  the  process  for  inclusion  in  the 
organization’s  process  asset  library. 

4.  Propose  improvements  to  the  organizational  process  assets. 


Applying  Generic  Practices 

Generic  practices  are  components  that  can  be  applied  to  all  process  areas. 
Think  of  generic  practices  as  reminders.  They  serve  the  purpose  of 
reminding  you  to  do  things  right  and  are  expected  model  components. 

For  example,  consider  the  generic  practice,  “Establish  and  maintain  the 
plan  for  performing  the  process”  (GP  2.2).  When  applied  to  the  Project 
Planning  process  area,  this  generic  practice  reminds  you  to  plan  the 
activities  involved  in  creating  the  plan  for  the  project.  When  applied  to  the 
Organizational  Training  process  area,  this  same  generic  practice  reminds 
you  to  plan  the  activities  involved  in  developing  the  skills  and  knowledge  of 
people  in  the  organization. 


Process  Areas  that  Support  Generic  Practices 


While  generic  goals  and  generic  practices  are  the  model  components  that 
directly  address  the  institutionalization  of  a  process  across  the  organization, 
many  process  areas  likewise  address  institutionalization  by  supporting  the 
implementation  of  the  generic  practices.  Knowing  these  relationships  will 
help  you  effectively  implement  the  generic  practices. 

Such  process  areas  contain  one  or  more  specific  practices  that  when 
implemented  can  also  fully  implement  a  generic  practice  or  generate  a  work 
product  that  is  used  in  the  implementation  of  a  generic  practice. 

An  example  is  the  Configuration  Management  process  area  and  GP  2.6, 
“Place  selected  work  products  of  the  process  under  appropriate  levels  of 
control.”  To  implement  the  generic  practice  for  one  or  more  process  areas, 
you  might  choose  to  implement  the  Configuration  Management  process 
area,  all  or  in  part,  to  implement  the  generic  practice. 

Another  example  is  the  Organizational  Process  Definition  process  area  and 
GP  3.1,  “Establish  and  maintain  the  description  of  a  defined  process.”  To 
implement  this  generic  practice  for  one  or  more  process  areas,  you  should 
first  implement  the  Organizational  Process  Definition  process  area,  all  or  in 
part,  to  establish  the  organizational  process  assets  that  are  needed  to 
implement  the  generic  practice. 

Table  6.2  describes  (1)  the  process  areas  that  support  the  implementation 
of  generic  practices  and  (2)  the  recursive  relationships  between  generic 
practices  and  their  closely  related  process  areas.  Both  types  of 
relationships  are  important  to  remember  during  process  improvement  to 
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take  advantage  of  the  natural  synergies  that  exist  between  the  generic 
practices  and  their  related  process  areas. 


Table  6.2  Generic  Practice  and  Process  Area  Relationships 


Generic  Practice 

Roles  of  Process  Areas  in 

Implementation  of  the  Generic  Practice 

How  the  Generic  Practice  Recursively 
Applies  to  its  Related  Process  Area(s)1 2 

GP  2.2 

Plan  the  Process 

Project  Planning:  The  project  planning 
process  can  implement  GP  2.2  in  full  for 
all  project  related  process  areas  (except 
for  Project  Planning  itself). 

GP  2.2  applied  to  the  project  planning 
process  can  be  characterized  as  “plan 
the  plan”  and  covers  planning  project 
planning  activities. 

Project  Planning:  The  part  of  the 
project  planning  process  that 
implements  Project  Planning  SP  2.4, 
“Plan  the  Project’s  Resources,”  supports 
the  implementation  of  GP  2.3  and  GP 
2.4  for  all  project  related  process  areas 
(except  perhaps  initially  for  Project 
Planning  itself)  by  identifying  needed 
processes,  roles,  and  responsibilities  to 
ensure  the  proper  staffing,  facilities, 
equipment,  and  other  assets  needed  by 
the  project  are  secured. 


GP  2.3 
Provide 
Resources 

GP  2.4 
Assign 

Responsibility 


GP  2.5 
Train  People 


Organizational  Training:  The 

organizational  training  process  supports 
the  implementation  of  GP  2.5  as  applied 
to  all  process  areas  by  making  the 
training  that  addresses  strategic  or 
organization-wide  training  needs 
available  to  those  who  will  perform  or 
support  the  process. 

Project  Planning:  The  part  of  the 
project  planning  process  that 
implements  Project  Planning  SP  2.5, 
“Plan  Needed  Knowledge  and  Skills,” 
and  the  organizational  training  process, 
supports  the  implementation  of  GP  2.5 
in  full  for  all  project  related  process 
areas. 


GP  2.5  applied  to  the  organizational 
training  process  covers  training  for 
performing  the  organizational  training 
activities,  which  addresses  the  skills 
required  to  manage,  create,  and 
accomplish  the  training. 


GP  2.6 
Control  Work 
Products 


Configuration  Management:  The 

configuration  management  process  can 
implement  GP  2.6  in  full  for  all  project 
related  process  areas  as  well  as  some 
of  the  organizational  process  areas. 


GP  2.6  applied  to  the  configuration 
management  process  covers  change 
and  version  control  for  the  work 
products  produced  by  configuration 
management  activities. 


12  When  the  relationship  between  a  generic  practice  and  a  process  area  is  less  direct,  the  risk  of  confusion  is  reduced;  therefore, 
we  do  not  describe  all  recursive  relationships  in  the  table  (e.g.,  for  generic  practices  2.3,  2.4,  and  2.10). 
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Generic  Practice  Roles  of  Process  Areas  in 

Implementation  of  the  Generic  Practice 


How  the  Generic  Practice  Recursively 
Applies  to  its  Related  Process  Area(s)12 


GP  2.7 
Identify  and 
Involve  Relevant 
Stakeholders 


Project  Planning:  The  part  of  the 
project  planning  process  that 
implements  Project  Planning  SP  2.6, 
“Plan  Stakeholder  Involvement,”  can 
implement  the  stakeholder  identification 
part  (first  two  subpractices)  of  GP  2.7  in 
full  for  all  project  related  process  areas. 

Project  Monitoring  and  Control:  The 

part  of  the  project  monitoring  and  control 
process  that  implements  Project 
Monitoring  and  Control  SP  1.5,  “Monitor 
Stakeholder  Involvement,”  can  aid  in 
implementing  the  third  subpractice  of 
GP  2.7  for  all  project  related  process 
areas. 


GP  2.7  applied  to  the  project  planning 
process  covers  the  involvement  of 
relevant  stakeholders  in  project  planning 
activities. 

GP  2.7  applied  to  the  project  monitoring 
and  control  process  covers  the 
involvement  of  relevant  stakeholders  in 
project  monitoring  and  control  activities. 

GP  2.7  applied  to  the  integrated  project 
management  process  covers  the 
involvement  of  relevant  stakeholders  in 
integrated  project  management 
activities. 


Integrated  Project  Management:  The 

part  of  the  integrated  project 
management  process  that  implements 
Integrated  Project  Management  SP  2.1, 
“Manage  Stakeholder  Involvement,”  can 
aid  in  implementing  the  third  subpractice 
of  GP  2.7  for  all  project  related  process 
areas. 


GP  2.8 
Monitor  and 
Control  the 
Process 


Project  Monitoring  and  Control:  The 

project  monitoring  and  control  process 
can  implement  GP  2.8  in  full  for  all 
project  related  process  areas. 

Measurement  and  Analysis:  For  all 

processes,  not  just  project  related 
processes,  the  Measurement  and 
Analysis  process  area  provides  general 
guidance  about  measuring,  analyzing, 
and  recording  information  that  can  be 
used  in  establishing  measures  for 
monitoring  performance  of  the  process. 


GP  2.8  applied  to  the  project  monitoring 
and  control  process  covers  the 
monitoring  and  controlling  of  the 
project’s  monitor  and  control  activities. 


GP  2.9 
Objectively 
Evaluate 
Adherence 


Process  and  Product  Quality 
Assurance:  The  process  and  product 
quality  assurance  process  can 
implement  GP  2.9  in  full  for  all  process 
areas  (except  perhaps  for  Process  and 
Product  Quality  Assurance  itself). 


GP  2.9  applied  to  the  process  and 
product  quality  assurance  process 
covers  the  objective  evaluation  of  quality 
assurance  activities  and  selected  work 
products. 
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Generic  Practice  Roles  of  Process  Areas  in 

Implementation  of  the  Generic  Practice 


How  the  Generic  Practice  Recursively 
Applies  to  its  Related  Process  Area(s)12 


GP  2.10 
Review  Status 
with  Higher  Level 
Management 


Project  Monitoring  and  Control:  The 

part  of  the  project  monitoring  and  control 
process  that  implements  Project 
Monitoring  and  Control  SP  1.6,  “Conduct 
Progress  Reviews,”  and  SP  1.7, 
“Conduct  Milestone  Reviews,”  supports 
the  implementation  of  GP  2.10  for  all 
project  related  process  areas,  perhaps 
in  full,  depending  on  higher  level 
management  involvement  in  these 
reviews. 


GP  3.1 
Establish  a 
Defined  Process 


Integrated  Project  Management:  The 

part  of  the  integrated  project 
management  process  that  implements 
Integrated  Project  Management  SP  1 .1 , 
“Establish  the  Project’s  Defined 
Process,”  can  implement  GP  3.1  in  full 
for  all  project  related  process  areas. 

Organizational  Process  Definition: 

For  all  processes,  not  just  project  related 
processes,  the  organizational  process 
definition  process  establishes  the 
organizational  process  assets  needed  to 
implement  GP  3.1 . 


GP  3.1  applied  to  the  integrated  project 
management  process  covers 
establishing  defined  processes  for 
integrated  project  management 
activities. 


GP  3.2 

Collect  Process 

Related 

Experiences 


Integrated  Project  Management:  The 

part  of  the  integrated  project 
management  process  that  implements 
Integrated  Project  Management  SP  1.7, 
“Contribute  to  Organizational  Process 
Assets,”  can  implement  GP  3.2  in  part  or 
in  full  for  all  project  related  process 
areas. 

Organizational  Process  Focus:  The 

part  of  the  organizational  process  focus 
process  that  implements  Organizational 
Process  Focus  SP  3.4,  “Incorporate 
Experiences  into  Organizational  Process 
Assets,”  can  implement  GP  3.2  in  part  or 
in  full  for  all  process  areas. 

Organizational  Process  Definition: 

For  all  processes,  the  organizational 
process  definition  process  establishes 
the  organizational  process  assets 
needed  to  implement  GP  3.2. 


GP  3.2  applied  to  the  integrated  project 
management  process  covers  collecting 
process  related  experiences  derived 
from  planning  and  performing  integrated 
project  management  activities. 
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Given  the  dependencies  that  generic  practices  have  on  these  process 
areas,  and  given  the  more  holistic  view  that  many  of  these  process  areas 
provide,  these  process  areas  are  often  implemented  early,  in  whole  or  in 
part,  before  or  concurrent  with  implementing  the  associated  generic 
practices. 

There  are  also  a  few  situations  where  the  result  of  applying  a  generic 
practice  to  a  particular  process  area  would  seem  to  make  a  whole  process 
area  redundant,  but,  in  fact,  it  does  not.  It  can  be  natural  to  think  that 
applying  GP  3.1,  “Establish  a  Defined  Process,”  to  the  Project  Planning  and 
Project  Monitoring  and  Control  process  areas  gives  the  same  effect  as  the 
first  specific  goal  of  Integrated  Project  Management,  “Use  the  Project’s 
Defined  Process.” 

Although  it  is  true  that  there  is  some  overlap,  the  application  of  the  generic 
practice  to  these  two  process  areas  provides  defined  processes  covering 
project  planning  and  project  monitoring  and  control  activities.  These  defined 
processes  do  not  necessarily  cover  support  activities  (e.g.,  configuration 
management),  other  project  management  processes  (e.g.,  integrated 
project  management),  or  other  processes.  In  contrast,  the  project’s  defined 
process,  provided  by  the  Integrated  Project  Management  process  area, 
covers  all  appropriate  processes. 
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AGREEMENT  MANAGEMENT 


A  Project  Management  Process  Area  at  Maturity  Level  2 


Purpose 


The  purpose  of  Agreement  Management  (AM)  is  to  ensure  that  the  supplier 
and  the  acquirer  perform  according  to  the  terms  of  the  supplier  agreement. 


Introductory  Notes 


The  Agreement  Management  process  area  involves  the  following  activities: 

•  Executing  the  supplier  agreement 

•  Monitoring  supplier  processes 

•  Accepting  the  delivery  of  acquired  products 

•  Managing  supplier  invoices 

The  legal  nature  of  many  acquirer-supplier  agreements  makes  it  imperative 
that  the  project  management  team  is  acutely  aware  of  the  legal  implications 
of  actions  taken  when  managing  the  acquisition  of  products  or  services. 

The  supplier  agreement  is  the  basis  for  managing  the  relationship  with  the 
supplier,  including  resolving  issues.  It  defines  the  mechanisms  that  allow 
the  acquirer  to  oversee  the  supplier’s  activities  and  evolving  products  and  to 
verify  compliance  with  supplier  agreement  requirements.  It  is  also  the 
vehicle  for  a  mutual  understanding  between  the  acquirer  and  supplier. 

When  the  supplier’s  performance,  processes,  or  products  fail  to  satisfy 
established  criteria  as  outlined  in  the  supplier  agreement,  the  acquirer  may 
take  corrective  action. 


Related  Process  Areas 


Refer  to  the  Acquisition  Technical  Management  process  area  for  more 
information  about  evaluating  technical  solutions. 

Refer  to  the  Acquisition  Validation  process  area  for  more  information  about 
validating  selected  products  and  product  components. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  specifying  measures  and  communicating  results. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  the  project  against  the  plan  and  taking 
corrective  action. 

Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  supplier  agreements. 
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Specific  Goal  and  Practice  Summary 

SG  1  Satisfy  Supplier  Agreements 

SP  1 .1  Execute  the  Supplier  Agreement 
SP  1 .2  Monitor  Selected  Supplier  Processes 
SP  1 .3  Accept  the  Acquired  Product 
SP1.4  Manage  Supplier  Invoices 

Specific  Practices  by  Goal 


SG  1 _ Satisfy  Supplier  Agreements _ 

The  terms  of  the  supplier  agreement  are  met  by  both  the  acquirer  and  the 
supplier. 


SP  1 .1  Execute  the  Supplier  Agreement 

Perform  activities  with  the  supplier  as  specified  in  the  supplier 
agreement. 

This  specific  practice  covers  internal  and  external  communication  as  well  as 
the  use  of  information  by  the  acquirer  and  supplier  regarding  the 
relationship,  performance,  results,  and  impact  to  the  business.  The  acquirer 
manages  the  relationship  with  the  supplier  to  maintain  effective 
communication  on  key  issues  (e.g.,  changes  in  the  acquirer’s  business), 
new  supplier  products  and  technologies,  and  changes  in  the  organizational 
structure. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  the  project  against  the  plan  and  taking 
corrective  action. 

Example  Work  Products 

1 .  Integrated  list  of  issues 

2.  Acquisition  project  progress  and  performance  reports 

3.  Supplier  review  materials  and  reports 

4.  Action  items  tracked  to  closure 

5.  Records  of  product  and  document  deliveries 

Example  Supplier  Deliverables 

1 .  Supplier  project  progress  and  performance  reports 

2.  Corrective  action  results  for  supplier  issues 

3.  Correspondence  with  the  acquirer 

Subpractices 

1 .  Monitor  supplier  project  progress  and  performance  (e.g.,  schedule, 
effort,  cost)  as  defined  in  the  supplier  agreement. 

2.  Conduct  management  reviews  with  the  supplier  as  specified  in  the 
supplier  agreement. 

Reviews  cover  both  formal  and  informal  reviews  and  include  the  following  steps: 
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•  Preparing  for  the  review 

•  Ensuring  that  relevant  stakeholders  participate 

•  Conducting  the  review 

•  Identifying,  documenting,  and  tracking  ail  action  items  to  closure 

•  Preparing  and  distributing  to  the  relevant  stakeholders  a  summary  report  of  the 
review 

i  Management  reviews  typically  include  the  following: 
i  •  Reviewing  critical  dependencies 
:  •  Reviewing  project  risks  involving  the  supplier 
i_  •  Reviewing  schedule  and  budget 


Refer  to  the  Acquisition  Technical  Management  process  area  for  more 
information  about  conducting  technical  reviews. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  conducting  milestone  reviews. 

3.  Identify  issues  and  determine  corrective  actions  necessary  to  resolve 
and  track  them  to  closure. 

Refer  to  the  Manage  Corrective  Action  to  Closure  specific  goal  in  the 
Project  Monitoring  and  Control  process  area  for  more  information 
about  tracking  corrective  actions  to  closure. 

Unresolved  issues  escalate  through  the  appropriate  management  chain  according  to 
the  organization’s  issue  resolution  process. 

4.  Use  the  results  of  reviews  to  improve  the  supplier’s  performance  and  to 
establish  and  nurture  long-term  relationships  with  preferred  suppliers. 

5.  Monitor  risks  involving  the  supplier  and  take  corrective  action  as 
necessary. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  project  risks. 

SP  1.2  Monitor  Selected  Supplier  Processes 

Select,  monitor,  and  analyze  supplier  processes. 

When  there  must  be  tight  alignment  between  supplier  and  acquirer 
processes,  the  acquirer  should  monitor  these  processes  to  help  prevent 
interface  problems. 

Selecting  processes  for  monitoring  involves  considering  the  impact  of  the 
supplier’s  processes  on  the  project.  On  larger  projects  with  significant 
subcontracts  for  development  of  critical  components,  monitoring  key 
processes  is  expected.  For  less  critical  components,  the  selection  process 
can  determine  that  monitoring  is  not  appropriate.  Between  these  extremes, 
the  overall  risk  should  be  considered  when  selecting  processes  to  be 
monitored. 

The  acquirer  should  also  determine  the  levels  to  which  the  selected  supplier 
processes  should  be  monitored.  Monitoring,  if  not  performed  with  adequate 
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care,  can  at  one  extreme  be  invasive  and  burdensome,  or  at  the  other 
extreme  be  uninformative  and  ineffective.  The  acquirer  decides  on  the 
necessary  level  of  monitoring  depending  on  the  level  of  risk  if  the  supplier’s 
process  is  not  performed  correctly  and  the  impact  the  monitoring  activity  will 
have  (i.e.,  the  value  of  information  obtained  and  its  cost  to  both  parties). 
Monitoring  activities  can  range  from  reviewing  supplier  supplied  process 
data  to  on-site  appraisals  of  the  supplier’s  processes. 

Analyzing  selected  processes  involves  taking  the  data  obtained  from 
monitoring  the  processes  and  analyzing  them  to  determine  whether  there 
are  serious  issues. 

|  As  an  example,  the  acquirer  may  need  to  monitor  and  analyze  selected  supplier 
i  development  processes  to  ensure  that  nonfunctional  requirements  receive  appropriate 
:  attention. 

i . . . 


Example  Work  Products 

1 .  List  of  processes  selected  for  monitoring  or  rationale  for  non-selection 

2.  Activity  reports 

3.  Process  performance  reports 

4.  Process  performance  curves 

5.  Discrepancy  reports 

Example  Supplier  Deliverables 

1 .  Supplier  process  quality  assurance  reports 

Subpractices 

1 .  Identify  supplier  processes  critical  to  the  success  of  the  project. 

2.  Monitor  selected  supplier  processes  for  compliance  with  requirements 
of  the  agreement. 

3.  Analyze  results  of  monitoring  selected  processes  to  detect  issues  as 
early  as  possible  that  may  affect  the  supplier’s  ability  to  satisfy 
requirements  of  the  agreement. 

Trend  analysis  can  rely  on  internal  and  external  data. 

SP  1 .3  Accept  the  Acquired  Product 

Ensure  that  the  supplier  agreement  is  satisfied  before  accepting 
the  acquired  product. 

This  practice  involves  ensuring  that  the  acquired  product  meets  all 
requirements  and  that  customers  concur  before  acceptance  of  the  product. 
The  acquirer  ensures  that  all  acceptance  criteria  have  been  satisfied  and 
that  all  discrepancies  have  been  corrected.  Requirements  for  formal 
deliverable  acceptance  and  how  to  address  non-conforming  deliverables 
are  usually  defined  in  the  supplier  agreement.  The  acquirer  should  be 
prepared  to  exercise  all  remedies  if  the  supplier  fails  to  perform. 
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The  acquirer,  usually  through  its  authorized  supplier  agreement 
administrator,  provides  the  supplier  with  formal  written  notice  that  supplier 
deliverables  have  been  accepted  or  rejected. 

Typically,  an  authorized  representative  of  the  acquirer  assumes  ownership 
of  existing  identified  supplier  products  or  deliverables  tendered,  or  approves 
services  rendered,  as  partial  or  complete  satisfaction  of  the  supplier 
agreement. 

The  acquirer  has  defined  how  this  product  or  service  will  make  the 
transition  to  operations  and  support  in  the  transition  to  operations  and 
support  plan.  Transition  to  operations  and  support  activities  are  monitored 
by  the  acquirer. 

Refer  to  the  Monitor  Transition  to  Operations  and  Support  specific  practice 
in  the  Project  Monitoring  and  Control  process  area  for  more  information 
about  monitoring  transition  activities. 

Refer  to  the  Plan  Transition  to  Operations  and  Support  specific  practice  in 
the  Project  Planning  process  area  for  more  information  about  planning  for 
the  transition  of  the  accepted  product  or  service. 

Example  Work  Products 

1 .  Stakeholder  approval  reports 

2.  Discrepancy  reports 

3.  Product  acceptance  review  report  with  approval  signatures 

Example  Supplier  Deliverables 

1 .  Work  products  as  defined  in  the  supplier  agreement 

2.  Services  as  defined  in  the  supplier  agreement 

Subpractices 

1 .  Review  the  validation  results,  reports,  logs,  and  issues  for  the  acquired 
product. 

Refer  to  the  Acquisition  Validation  process  area  for  more  information 
about  validating  selected  products  and  product  components. 

2.  Review  supplier  verification  results,  reports,  logs,  and  issues  for  the 
acquired  product. 

3.  Confirm  that  all  contractual  requirements  for  the  acquired  product  are 
satisfied. 

This  subpractice  can  include  confirming  that  appropriate  license,  warranty,  ownership, 
usage,  and  support  or  maintenance  agreements  are  in  place  and  all  supporting 
materials  are  received. 

4.  Confirm  that  all  discrepancies  have  been  corrected  and  all  acceptance 
criteria  have  been  satisfied. 

5.  Communicate  to  relevant  stakeholders  that  the  supplier  agreement  has 
been  satisfied. 
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The  acquirer,  usually  through  its  authorized  supplier  agreement  or  contract 
administrator,  provides  the  supplier  with  formal  written  notice  that  the  supplier 
agreement  has  been  satisfied  so  the  supplier  can  be  paid  and  the  supplier  agreement 
closed. 

6.  Communicate  to  relevant  stakeholders  the  product’s  readiness  for 
transition  to  operations  and  support. 

SP  1.4  Manage  Supplier  Invoices 

Manage  invoices  submitted  by  the  supplier. 

The  intent  of  this  practice  is  to  ensure  that  payment  terms  defined  in  the 
supplier  agreement  are  met  and  that  supplier  compensation  is  linked  to 
supplier  progress,  as  defined  in  the  supplier  agreement.  This  practice 
covers  invoices  for  any  type  of  charge  (e.g.,  one-time,  monthly,  deliverable- 
based,  pass-through).  It  covers  invoice  errors  or  issues,  changes  to 
invoices,  billing  errors,  and  withholding  disputed  charges  consistent  with  the 
terms  and  conditions  of  the  supplier  agreement.  The  acquirer  should  also 
ensure  that  appropriate  financial  and  invoice  management  controls  are  in 
place. 

When  accepting  supplier  deliverables,  final  payment  should  not  be  made  to 
the  supplier  until  it  has  been  certified  that  all  supplier  deliverables  meet 
contractual  requirements  and  all  acceptance  criteria  have  been  satisfied. 
When  acceptance  criteria  have  not  been  satisfied,  the  provisions  of  the 
supplier  agreement  can  be  exercised. 

Example  Work  Products 

1 .  Invoices  approved  for  payment 

Example  Supplier  Deliverables 

1.  Invoices 

Subpractices 

1.  Receive  invoices. 

2.  Review  invoices  and  related  supporting  material. 

j  Examples  of  areas  of  review  for  invoices  and  related  support  material  include  the 
|  following: 

i  •  Volumes  for  variable  charges 
i  •  Pass  through  expenses 
:  •  Regulatory  commitments  related  to  payments 
i  •  Purchases  made  by  the  supplier  on  behalf  of  the  acquirer 

3.  Resolve  errors  and  manage  issues  with  the  supplier  as  required. 

4.  Approve  invoices. 
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ACQUISITION  REQUIREMENTS  DEVELOPMENT 

An  Acquisition  Engineering  Process  Area  at  Maturity  Level  2 


Purpose 


The  purpose  of  Acquisition  Requirements  Development  (ARD)  is  to  elicit, 
develop,  and  analyze  customer  and  contractual  requirements. 


Introductory  Notes 


This  process  area  describes  two  types  of  requirements:  customer 
requirements,  which  address  the  needs  of  relevant  stakeholders  for  which 
one  or  more  products  and  services  will  be  acquired,  and  contractual 
requirements,  which  are  the  requirements  to  be  addressed  through  the 
acquirer’s  relationship  with  suppliers  and  other  appropriate  organizations. 
Both  sets  of  requirements  should  address  needs  relevant  to  later  product 
lifecycle  phases  (e.g.,  operation,  maintenance,  support,  disposal)  and  key 
quality  attributes  (e.g.,  safety,  reliability,  maintainability). 

In  some  acquisitions,  the  acquirer  assumes  the  role  of  overall  systems 
engineer,  architect,  or  integrator  for  the  product.  In  these  acquisitions,  the 
Requirements  Development  process  area  of  CMMI-DEV  should  be  used. 
Requirements  Development  in  CMMI-DEV  includes  additional  information 
helpful  in  these  situations,  including  deriving  and  analyzing  requirements  at 
successively  lower  levels  of  product  definition  (e.g.,  establishing  and 
maintaining  product  component  requirements). 

Requirements  are  the  basis  for  the  selection  and  design  or  configuration  of 
the  acquired  product.  The  development  of  requirements  includes  the 
following  activities: 

•  Elicitation,  analysis,  and  validation  of  stakeholder  needs,  expectations, 
constraints,  and  interfaces  to  establish  customer  requirements  that 
constitute  an  understanding  of  what  will  satisfy  stakeholders 

•  Development  of  the  lifecycle  requirements  of  the  product  (e.g., 
development,  maintenance,  transition  to  operations,  decommissioning) 

•  Establishment  of  contractual  requirements  consistent  with  customer 
requirements  to  a  level  of  detail  that  is  sufficient  to  be  included  in  the 
solicitation  package  and  supplier  agreement 

•  Development  of  the  operational  concept 

•  Analysis  of  needs  and  requirements  (for  each  product  lifecycle  phase), 
the  operational  environment,  and  factors  that  reflect  overall  customer 
and  end-user  needs  and  expectations  for  quality  attributes 

•  Identification  of  quality  attributes,  which  are  non-functional  properties  of 
a  product  or  service  (e.g.,  responsiveness,  availability,  security)  and  are 
critical  to  customer  satisfaction  and  to  meeting  the  needs  of  relevant 
stakeholders  (See  the  definition  of  “quality  attributes”  in  the  glossary.) 
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The  requirements  included  in  the  solicitation  package  form  the  basis  for 
evaluating  proposals  by  suppliers  and  for  further  negotiations  with  suppliers 
and  communication  with  the  customer.  The  contractual  requirements  for  the 
supplier  are  baselined  in  the  supplier  agreement. 

Requirements  are  refined  throughout  the  project  lifecycle.  Design  decisions, 
subsequent  corrective  actions,  and  feedback  during  each  phase  of  the 
project’s  lifecycle  are  analyzed  for  their  impact  on  contractual  requirements. 

Requirements  analyses  aid  understanding,  defining,  and  selecting 
requirements  at  all  levels  from  competing  alternatives.  Analyses  occur 
recursively  at  successively  more  detailed  levels  until  sufficient  detail  is 
available  to  produce  contractual  requirements  and  to  further  refine  these 
requirements,  if  necessary,  while  the  supplier  builds  or  configures  the 
product. 

Involvement  of  relevant  stakeholders  in  both  requirements  development 
and  analyses  gives  them  visibility  into  the  evolution  of  requirements. 
Participation  continually  assures  stakeholders  that  requirements  are  being 
properly  defined. 

The  Acquisition  Requirements  Development  process  area  includes  three 
specific  goals.  The  Develop  Customer  Requirements  specific  goal 
addresses  eliciting  and  defining  a  set  of  customer  requirements.  The 
Develop  Contractual  Requirements  specific  goal  addresses  defining 
contractual  requirements  that  are  based  on  customer  requirements  and  are 
included  in  the  solicitation  package  and  supplier  agreement.  The  specific 
practices  of  the  Analyze  and  Validate  Requirements  specific  goal  support 
the  development  of  the  requirements  in  the  first  two  specific  goals.  The 
specific  practices  associated  with  this  specific  goal  cover  analyzing  and 
validating  requirements  with  respect  to  the  acquirer’s  intended  environment. 


Related  Process  Areas 


Refer  to  the  Acquisition  Technical  Management  process  area  for  more 
information  about  evaluating  technical  solutions. 

Refer  to  the  Acquisition  Validation  process  area  for  more  information  about 
validating  selected  products  and  product  components. 

Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  a  solicitation  package  and 
establishing  supplier  agreements. 

Refer  to  the  Requirements  Management  process  area  for  more  information 
about  managing  requirements. 

Refer  to  the  Risk  Management  process  area  for  more  information  about 
identifying  and  analyzing  risks. 
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Specific  Goal  and  Practice  Summary 

SG  1  Develop  Customer  Requirements 
SP  1 .1  Elicit  Stakeholder  Needs 
SP  1.2  Develop  and  Prioritize  Customer  Requirements 
SG  2  Develop  Contractual  Requirements 

SP  2.1  Establish  Contractual  Requirements 

SP  2.2  Allocate  Contractual  Requirements 

SG  3  Analyze  and  Validate  Requirements 

SP  3.1  Establish  Operational  Concepts  and  Scenarios 

SP  3.2  Analyze  Requirements 

SP  3.3  Analyze  Requirements  to  Achieve  Balance 

SP  3.4  Validate  Requirements 

Specific  Practices  by  Goal 


SG  1 _ Develop  Customer  Requirements _ 

Stakeholder  needs,  expectations,  constraints,  and  interfaces  are  collected  and 
translated  into  customer  requirements. 

Stakeholders  (e.g.,  customers,  end  users,  suppliers,  testers,  integrators, 
maintainers,  operators,  supplier  agreement  management  staff, 
manufacturers,  logistics  support  staff)  are  sources  of  requirements.  Their 
needs,  expectations,  constraints,  interfaces,  operational  concepts,  and 
product  concepts  are  analyzed,  harmonized,  refined,  and  elaborated  for 
translation  into  a  set  of  customer  requirements. 

Frequently,  stakeholder  needs,  expectations,  constraints,  and  interfaces  are 
poorly  identified  or  conflicting.  Since  these  needs,  expectations,  constraints, 
and  interfaces  should  be  clearly  identified  and  understood  throughout  the 
project  lifecycle,  an  iterative  process  is  used  throughout  the  life  of  the 
project  to  accomplish  this  objective.  To  facilitate  the  required  interaction, 
relevant  stakeholders  are  frequently  involved  throughout  the  project 
lifecycle  to  communicate  their  needs,  expectations,  and  constraints,  and  to 
help  resolve  conflicts.  Environmental,  legal,  and  other  constraints  should  be 
considered  when  creating  and  evolving  the  set  of  requirements  to  be  used 
in  acquiring  products  or  services. 

SP1.1  Elicit  Stakeholder  Needs 

Elicit  stakeholder  needs,  expectations,  constraints,  and  interfaces 
for  all  phases  of  the  product  lifecycle. 

Eliciting  goes  beyond  collecting  needs  by  proactively  identifying  additional 
needs  not  explicitly  provided  by  stakeholders.  Relevant  stakeholders  who 
represent  all  phases  of  the  product  lifecycle  in  the  acquirer’s  intended 
environment  should  include  business  as  well  as  technical  functions.  Using 
this  approach,  needs  for  all  product  related  lifecycle  processes  are 
considered  concurrently  with  concepts  for  acquired  products. 

An  analysis  of  business  processes  is  a  common  source  of  stakeholder 
needs,  expectations,  constraints,  and  interfaces.  Additional  needs  typically 
address  project  lifecycle  activities  and  their  impact  on  the  product. 


Acquisition  Requirements  Development  (ARD) 


85 


CMMI  for  Acquisition,  Version  1.3 


Examples  of  techniques  to  elicit  needs  from  stakeholders  include  the  following: 

•  Questionnaires  and  interviews 

•  Scenarios  (operational,  sustainment,  and  development)  obtained  from  end  users  and 
other  relevant  stakeholders 

•  Operational  walkthroughs  and  end-user  task  analyses 

•  Quality  attribute  elicitation  workshops  with  stakeholders 

•  Prototypes  and  models 

•  Observation  of  existing  products,  environments,  and  workflow  patterns 

•  Technology  demonstrations 

•  Interim  project  reviews 

•  Brainstorming 

•  Quality  Function  Deployment 

•  Market  surveys 

•  Extraction  from  sources  such  as  business  process  documents,  standards,  or 
specifications 

•  Use  cases 

•  Business  case  analyses 

•  Reverse  engineering  (for  legacy  products) 

•  Customer  or  end  user  satisfaction  surveys 


Examples  of  sources  of  requirements  that  might  not  be  identified  by  the  customer  include 
the  following: 

•  Government  regulations 

•  Policies  and  standards 

•  Technology 

•  Legacy  products  or  product  components  (for  reuse) 


Example  Work  Products 

1 .  Stakeholder  needs,  expectations,  constraints,  and  interfaces 

Subpractices 

1 .  Engage  relevant  stakeholders  using  methods  for  eliciting  needs, 
expectations,  constraints,  and  external  interfaces. 

SP  1.2  Develop  and  Prioritize  Customer  Requirements 

Transform  stakeholder  needs,  expectations,  constraints,  and 
interfaces  into  prioritized  customer  requirements. 

The  customer  typically  describes  requirements  as  capabilities  expressed  in 
broad  operational  terms  concerned  with  achieving  a  desired  effect  under 
specified  standards  and  regulations.  Customer  requirements  can  also 
include  needs,  expectations,  constraints,  and  interfaces  with  regard  to 
verification  and  validation.  Inputs  from  the  customer  and  other  stakeholders 
should  be  aligned  to  the  acquisition  strategy.  Missing  information  should  be 
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obtained  and  conflicts  should  be  resolved  as  customer  requirements  are 
developed  and  prioritized. 

Customer  requirements  can  also  exist  as  an  output  of  another  activity  such 
as  a  previous  project  that  delivered  the  initial  capability;  or  a  possible  earlier 
customer  or  system-of-systems  office  related  activity  establishing 
architectural  principles,  interoperability  standards,  and  common  design 
constraints. 

Examples  of  factors  to  consider  when  expressing  customer  requirements  include  the 
following: 

•  Key  characteristics  of  the  desired  capability  with  appropriate  parameters  and  measures 

•  Obstacles  to  overcome  to  achieve  the  capability 

•  Competitive  gap  between  the  existing  and  the  desired  capability 

•  Supportability  of  the  desired  capability 

•  Level  of  detail  of  customer  requirements  that  does  not  prejudice  decisions  in  favor  of  a 
particular  means  of  implementation  but  are  specific  enough  to  evaluate  alternative 
approaches  to  implement  the  capability 


Example  Work  Products 

1 .  Prioritized  customer  requirements 

2.  Customer  constraints  on  the  conduct  of  verification 

3.  Customer  constraints  on  the  conduct  of  validation 

Subpractices 

1 .  Translate  stakeholder  needs,  expectations,  constraints,  and  interfaces 
into  documented  customer  requirements. 

2.  Establish  and  maintain  a  prioritization  of  customer  functional  and 
quality  attribute  requirements. 

Having  prioritized  customer  requirements  guides  the  acquirer  in  determining  project 
scope  and  which  requirements  and  requirements  changes  to  include  in  supplier 
agreements.  This  prioritization  ensures  that  functional  and  quality  attribute 
requirements  critical  to  the  customer  and  other  relevant  stakeholders  are  addressed 
quickly. 

Determining  priorities  and  resolving  conflicts  among  them  can  be  addressed  when 
eliciting  stakeholder  needs,  as  described  in  the  previous  specific  practice. 

3.  Define  constraints  for  verification  and  validation. 

SG  2 _ Develop  Contractual  Requirements _ 

Customer  requirements  are  refined  and  elaborated  into  contractual 
requirements. 

Customer  requirements  are  analyzed  in  conjunction  with  the  development 
of  the  operational  concept  to  derive  more  detailed  and  precise  sets  of 
requirements,  called  contractual  requirements,  to  be  included  in  the 
solicitation  package  for  potential  suppliers  and  eventually  in  the  supplier 
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agreement.  The  level  of  detail  of  contractual  requirements  is  based  on  the 
acquisition  strategy  and  project  characteristics. 

Contractual  requirements  arise  from  constraints,  consideration  of  issues 
implied  but  not  explicitly  stated  in  the  customer  requirements  baseline,  and 
factors  introduced  by  design  constraints  and  supplier  capabilities. 
Contractual  requirements  include  both  requirements  documented  in 
contracts  between  an  acquirer  and  supplier  and  requirements  addressed 
through  formal  agreements  between  the  acquirer  and  other  organizations 
(e.g.,  partners,  subcontractors,  government  agencies,  internal 
organizational  units).  (See  the  definition  of  “contractual  requirements”  in  the 
glossary.)  Requirements  are  reexamined  throughout  the  project  lifecycle. 

The  requirements  are  allocated  to  supplier  deliverables.  The  traceability 
across  levels  of  requirements  and  supplier  deliverables  (and  planned 
supplier  delivery  increments)  is  documented. 

Refer  to  the  Requirements  Management  process  area  for  more  information 
about  maintaining  bidirectional  traceability  of  requirements. 

SP  2.1  Establish  Contractual  Requirements 

Establish  and  maintain  contractual  requirements  that  are  based  on 
the  customer  requirements. 

Customer  requirements  can  be  expressed  in  the  customer’s  terms  and  can 
be  nontechnical  descriptions.  Contractual  requirements  are  the  expression 
of  these  requirements  in  technical  terms  that  can  be  used  for  design 
decisions. 

In  addition  to  technical  requirements  (e.g.,  requirements  specifying 
interfaces  with  other  products  or  applications,  functional  and  operationally 
related  quality  attribute  requirements  and  their  validation,  technical 
performance  measures,  verification  requirements  such  as  product 
acceptance  criteria),  contractual  requirements  cover  nontechnical 
stakeholder  needs,  expectations,  constraints,  and  interfaces. 

:  Examples  of  nontechnical  requirements  include  the  following: 

i  •  Frequency  and  format  of  supplier  reviews 
i  •  Supplier  reports  and  other  communication 

j  •  Availability  of  support  to  meet  levels  of  the  business  process  or  product  performance 
:  •  Warranty  of  products  provided  by  a  supplier 
i  •  Logistics  support  that  sustains  both  short-  and  long-term  readiness 
:  •  Minimal  total  lifecycle  cost  to  own  and  operate  (i.e.,  minimal  total  ownership  cost) 

:  •  Maintenance  concepts  that  optimize  readiness  while  drawing  on  both  acquirer  and 
|  supplier  sources 

:  •  Data  management  and  configuration  management  that  facilitates  cost  effective  product 
:  support  throughout  the  product’s  use  by  the  acquirer 


The  modification  of  requirements  due  to  approved  requirement  changes  is 
covered  by  the  maintain  aspect  of  this  specific  practice;  whereas,  the 
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administration  of  requirement  changes  is  covered  by  the  Requirements 
Management  process  area. 

Refer  to  the  Requirements  Management  process  area  for  more  information 
about  managing  requirements. 

Example  Work  Products 

1 .  External  interface  requirements 

2.  Prioritized  contractual  requirements 

Subpractices 

1 .  Develop  functional  and  quality  attribute  requirements  necessary  for  the 
determination  of  alternative  solutions  and  the  development  of  the 
product  by  the  supplier. 

Priorities  can  be  assigned  to  product  requirements  to  provide  a  basis  for  future 
requirements  tradeoffs  should  such  tradeoffs  become  necessary.  Acquirers  may 
assign  priorities  using  categories  such  as  Essential,  Important,  or  Desirable. 

2.  Develop  requirements  for  the  interfaces  between  the  acquired  product 
and  other  products  in  the  intended  environment. 

Requirements  for  interfaces  are  defined  in  terms  of  origination,  destination,  stimulus, 
data  characteristics  for  software,  and  electrical  and  mechanical  characteristics  for 
hardware. 

3.  Develop  design  considerations  and  constraints  necessary  for  supplier 
activities  that  include:  determination  of  alternative  solutions, 
development  and  evaluation  of  architectures,  and  the  development  of 
the  product. 

Design  considerations  and  constraints  address  the  quality  attributes  and  technical 
performance  that  are  critical  to  the  success  of  the  product  in  its  intended  operational 
environment.  They  account  for  customer  requirements  relative  to  product 
interoperability,  implications  from  the  use  of  commercial  off-the-shelf  (COTS)  products, 
safety,  security,  durability,  and  other  mission  critical  concerns. 

To  achieve  high  levels  of  reuse  and  interoperability,  acquirers  can  establish  common 
design  constraints  for  products  or  product  families  that  can  be  deployed  in  one  or  more 
domains.  Alternatively,  acquirers  can  accelerate  the  development  of  technical 
requirements  and  design  constraints  by  reusing  shared  or  common  constraints  or 
requirements  and  their  associated  test  cases  from  previous  acquisitions  or  leverage 
the  supplier’s  previous  product  developments. 

Common  design  constraints  can  also  be  established  and  maintained  by  a  customer 
organization  or  system-of-systems  office  for  a  group  of  acquisitions  collectively 
intended  to  establish  a  major  capability  (e.g.,  for  systems-of-systems,  product  lines, 
standard  services). 

4.  Develop  requirements  for  verification  and  validation  of  the  product  to 
be  developed  by  the  supplier. 

Requirements  for  verification  and  validation  typically  include  types  and  coverage  of 
testing  and  review  to  be  carried  out  in  the  supplier’s  and  acquirer’s  environments. 
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Testing  requirements  can  include  mirroring  the  production  environment  of  the  acquirer, 
the  type  of  test  data  to  be  used,  and  simulated  testing  of  interfaces  with  other 
products. 


5.  Establish  and  maintain  relationships  among  the  requirements  under 
consideration  during  change  management  and  requirements  allocation. 

Relationships  between  requirements  can  affect  evaluating  the  impact  of  requirements 
changes.  Expected  requirements  volatility  is  a  key  factor  in  anticipating  scope  changes 
and  supporting  the  acquirer’s  selection  of  the  appropriate  acquisition  type. 

6.  Identify  nontechnical  requirements. 

Contractual  requirements  consist  of  both  technical  and  nontechnical  requirements. 
Examples  of  nontechnical  requirements  are  listed  in  the  example  box  in  this  specific 
practice. 

7.  Establish  and  maintain  a  prioritization  of  contractual  requirements. 

Priority  can  be  based  on  a  combination  of  several  factors  that  include  customer 
desires,  costs,  timeframe  for  when  the  capabilities  are  needed,  and  length  of  time  to 
satisfy  a  particular  requirement. 

When  cost  estimates  can  be  determined  for  contractual  requirements,  their  priority  and 
costs  can  be  used  to  guide  contract  and  budget  negotiations  and  to  determine  which 
changes  should  be  made  to  the  contract. 

Priority  can  also  help  when  developing  a  release  strategy  (e.g.,  first  release  only 
addresses  high  priority  requirements;  lower  priority  requirements  are  deferred  to  a  later 
release  or  maintenance  phase). 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
establishing  the  acquisition  strategy  and  estimating  effort  and  cost. 

SP  2.2  Allocate  Contractual  Requirements 

Allocate  contractual  requirements  to  supplier  deliverables. 

Contractual  requirements  are  allocated,  as  appropriate,  to  supplier 
deliverables.  The  requirements  for  each  supplier  deliverable  are 
documented.  In  some  cases,  technical  requirements  are  allocated  to  third- 
party  products  that  are  used  by  the  supplier  (e.g.,  COTS  products). 

Example  Work  Products 

1 .  Requirement  allocation  sheets 

Subpractices 

1 .  Allocate  requirements  to  supplier  deliverables. 

In  the  case  of  an  evolutionary  acquisition  lifecycle,  the  requirements  for  the  initial 
capability  can  also  be  allocated  to  suppliers’  initial  iterations  or  increments  based  on 
stakeholder  priorities,  technology  issues,  supplier  capabilities,  and  acquirer  project 
objectives. 

2.  Allocate  design  constraints  to  supplier  deliverables. 
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3.  Document  relationships  among  allocated  requirements  and  design 
constraints. 

Relationships  include  dependencies  (i.e.,  a  change  in  one  requirement  can  affect  other 
requirements). 

4.  Allocate  requirements  to  suppliers. 

In  situations  where  multiple  suppliers  are  involved  in  developing  the  technical  solution, 
different  products  or  product  components  may  be  allocated  to  different  suppliers. 

5.  Develop  an  approach  to  address  requirements  that  by  their  nature  are 
shared  among  multiple  stakeholders  (e.g.,  the  acquirer,  multiple 
suppliers,  customers,  end  users). 

Some  requirements  (in  particular,  for  some  quality  attribute  requirements)  should  be 
shared  among  multiple  stakeholders  and  maintained  through  the  life  of  the  product 
(e.g.,  security  requirements  often  cannot  be  allocated  to  a  single  supplier).  An 
approach  that  addresses  such  requirements  should  be  devised  and  appropriately 
incorporated  in  customer  and  supplier  agreements. 

Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  supplier  agreements. 

SG  3  Analyze  and  Validate  Requirements 

Requirements  are  analyzed  and  validated. 

Analyses  are  performed  to  determine  the  impact  the  intended  operational 
environment  will  have  on  the  ability  to  satisfy  stakeholder  needs, 
expectations,  constraints,  and  interfaces.  Considerations  such  as  feasibility, 
mission  needs,  cost  constraints,  potential  market  size,  and  acquisition 
strategy  should  all  be  taken  into  account,  depending  on  the  product  context. 

The  objectives  of  these  analyses  are  (1)  to  determine  candidate 
requirements  for  product  concepts  that  will  satisfy  stakeholder  needs, 
expectations,  constraints,  and  interfaces  and  (2)  to  translate  these  concepts 
into  requirements.  In  parallel  with  these  activities,  the  parameters  to  be 
used  to  evaluate  the  effectiveness  of  the  product  are  determined  based  on 
customer  input  and  the  preliminary  product  concept. 

Requirements  are  validated  to  increase  the  probability  that  the  resulting 
product  will  perform  as  intended  in  the  acquirer’s  intended  environment. 

SP  3.1  Establish  Operational  Concepts  and  Scenarios 

Establish  and  maintain  operational  concepts  and  associated 
scenarios. 

Operational  concepts  or  concepts  of  operation  are  overall  descriptions  of 
the  problems  to  be  solved  in  operational  terms  and  the  ways  in  which  the 
products  to  be  acquired  are  intended  to  be  used  or  operated,  deployed, 
supported  (including  maintenance  and  sustainment),  and  disposed.  The 
acquirer  explicitly  accounts  for  design  constraints. 
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For  example,  the  operational  concept  for  a  satellite  based  communications  product  is  quite 
different  from  one  based  on  landlines. 


In  contrast,  a  scenario  is  a  description  of  a  sequence  of  events  that  might 
occur  in  the  use,  transition,  or  sustainment  of  the  product  to  be  acquired 
and  makes  explicit  some  stakeholder  functionality  and  quality  attribute 
needs.  Typically,  scenarios  are  derived  from  business  process  descriptions 
and  operational  concepts. 

Operational  concepts  and  scenarios  can  assist  in  the  elicitation  of  needs 
and  the  analysis  and  refinement  of  requirements.  Operational  concepts  and 
scenarios  can  be  further  refined  as  solution  decisions  are  made  and  more 
detailed  requirements  are  developed.  They  are  evolved  to  facilitate  the 
validation  of  technical  solutions  delivered  by  the  supplier. 

Example  Work  Products 

1 .  Operational,  maintenance,  support,  and  disposal  concepts 

2.  Use  cases,  user  stories 

3.  New  requirements 

Subpractices 

1 .  Develop  operational  concepts  and  scenarios  that  include  operations, 
installation,  maintenance,  support,  and  disposal  as  appropriate. 

Augment  scenarios  with  quality  attribute  considerations  for  the  functions  (or  other 
logical  entities)  described  in  the  scenario. 

2.  Define  the  environment  in  which  the  product  will  operate,  including 
boundaries  and  constraints. 

3.  Review  operational  concepts  and  scenarios  to  refine  and  discover 
requirements. 

Operational  concept  and  scenario  development  is  an  iterative  process.  Reviews 
should  be  held  periodically  to  ensure  that  the  operational  concepts  and  scenarios 
agree  with  the  requirements.  The  review  can  be  in  the  form  of  a  walkthrough. 

4.  Develop  a  detailed  operational  concept,  as  candidate  solutions  are 
identified  and  product  and  product  component  solutions  are  selected 
by  the  supplier,  that  defines  the  interaction  of  the  product,  the  end 
user,  and  the  environment,  and  that  satisfies  operational,  maintenance, 
support,  and  disposal  needs. 

SP  3.2  Analyze  Requirements 

Analyze  requirements  to  ensure  they  are  necessary  and  sufficient. 

As  contractual  requirements  are  defined,  their  relationship  to  customer 
requirements  should  be  understood.  In  light  of  the  operational  concepts  and 
scenarios,  the  contractual  requirements  are  analyzed  to  determine  whether 
they  are  necessary  and  sufficient  to  meet  customer  requirements.  The 
analyzed  requirements  then  provide  the  basis  for  more  detailed  and  precise 
requirements  throughout  the  project  lifecycle. 
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Also,  which  key  requirements  will  be  used  to  track  technical  progress  is 
determined.  For  instance,  the  weight  of  a  product  or  size  of  a  software 
product  can  be  monitored  through  development  based  on  its  risk  or  its 
criticality  to  the  customer  or  end  user. 

Refer  to  the  Acquisition  Technical  Management  process  area  for  more 
information  about  conducting  technical  reviews. 

Example  Work  Products 

1 .  Requirements  defects  reports 

2.  Proposed  requirements  changes  to  resolve  defects 

3.  Key  requirements 

4.  Technical  performance  measures 

Subpractices 

1 .  Analyze  stakeholder  needs,  expectations,  constraints,  and  external 
interfaces  to  organize  into  related  subjects  and  remove  conflicts. 

2.  Analyze  requirements  to  determine  whether  they  satisfy  higher  level 
requirements. 

3.  Analyze  requirements  to  ensure  that  they  are  complete,  feasible, 
realizable,  and  verifiable. 

4.  Analyze  and  propose  the  allocation  of  requirements. 

5.  Identify  key  requirements  that  have  a  strong  influence  on  cost, 
schedule,  performance,  or  risk. 

These  key  requirements  often  reflect  cross-cutting  (i.e.,  system-level)  concerns  and 
often  address  quality  attributes  that  will  be  a  major  driver  to  a  supplier’s  architecture 
definition  and  evaluation  activities.  A  clear  understanding  of  such  quality  attributes 
(also  known  as  “architecturally  significant  quality  attributes”)  and  their  importance 
based  on  mission  or  business  needs  is  essential  to  an  effective  analysis  of 
requirements  and  to  effective  technical  performance  measurement. 

6.  Identify  technical  performance  measures  to  be  tracked  during  the 
acquisition. 

Technical  performance  measures  are  precisely  defined  measures  based  on  a  product 
requirement,  product  capability,  or  some  combination  of  requirements  and  capabilities. 
Technical  performance  measures  are  chosen  to  monitor  requirements  and  capabilities 
that  are  considered  key  factors  in  a  product’s  performance.  Data  for  technical 
performance  measures  are  provided  by  the  supplier  as  specified  in  the  supplier 
agreement. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  specifying  measures. 

7.  Analyze  operational  concepts  and  scenarios  to  refine  customer  needs, 
constraints,  and  interfaces  and  to  discover  new  requirements. 

This  analysis  can  result  in  more  detailed  operational  concepts  and  scenarios  as  well 
as  support  the  derivation  of  new  requirements. 
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SP  3.3  Analyze  Requirements  to  Achieve  Balance 

Analyze  requirements  to  balance  stakeholder  needs  and 
constraints. 

Stakeholder  needs  and  constraints  can  address  such  things  as  cost, 
schedule,  product  or  project  performance,  functionality,  reusable 
components,  maintainability,  or  risk. 

Requirements  are  analyzed  to  determine  whether  they  reflect  an 
appropriate  balance  among  cost,  schedule,  performance,  and  other  factors 
of  interest  to  relevant  stakeholders.  Models  and  simulations  can  be  used  to 
estimate  the  impacts  that  requirements  will  have  on  these  factors.  By 
involving  stakeholders  from  different  phases  of  the  product’s  lifecycle  in 
analyzing  these  impacts,  risks  can  be  determined.  If  the  risks  are 
considered  unacceptable,  the  requirements  can  be  revised  or  reprioritized 
to  improve  the  balance  of  cost,  schedule,  and  performance. 

Example  Work  Products 

1 .  Assessment  of  risks  related  to  requirements 

2.  Proposed  requirements  changes 

Subpractices 

1 .  Use  proven  models,  simulations,  and  prototyping  to  analyze  the 
balance  of  stakeholder  needs  and  constraints. 

Results  of  analyses  can  be  used  to  reduce  the  cost  of  the  product  and  the  risk  in 
acquiring  and  using  the  product. 

2.  Perform  a  risk  assessment  on  requirements  and  design  constraints. 

Refer  to  the  Risk  Management  process  area  for  more  information 
about  identifying  and  analyzing  risks. 

3.  Examine  product  lifecycle  concepts  for  impacts  of  requirements  on 
risks. 

4.  Perform  a  cost  benefit  analysis  to  assess  impact  of  the  requirements 
on  the  overall  acquisition  strategy  and  acquisition  project  costs  and 
risks. 

This  assessment  of  impact  often  focuses  on  an  evaluation  of  requirements  addressing 
architecturally  significant  quality  attributes.  As  an  example,  a  combination  of  tight 
response  time  requirements  and  high  reliability  requirements  could  prove  expensive  to 
implement.  Once  the  possible  impacts  are  better  understood,  the  requirements  can  be 
adjusted  to  achieve  a  better  balance  among  cost,  schedule,  performance,  and  risk; 
and  thus  enable  a  more  affordable  capability  to  be  acquired. 

SP  3.4  Validate  Requirements 

Validate  requirements  to  ensure  the  resulting  product  performs  as 
intended  in  the  end  user’s  environment. 

Requirements  validation  is  performed  early  in  the  acquisition  with  end  users 
or  their  representatives  to  gain  confidence  that  the  requirements  are 
capable  of  guiding  a  development  that  results  in  successful  final  validation. 
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This  activity  should  be  integrated  with  risk  management  activities.  Mature 
organizations  typically  perform  requirements  validation  in  a  more 
sophisticated  way  using  multiple  techniques  and  broaden  the  basis  of  the 
validation  to  include  other  stakeholder  needs  and  expectations.  These 
organizations  typically  perform  analyses,  prototyping,  and  simulations  to 
ensure  that  requirements  will  satisfy  stakeholder  needs  and  expectations. 

Examples  of  techniques  used  for  requirements  validation  include  the  following: 

•  Analysis 

•  Simulations 

•  Prototyping 

•  Demonstrations 


Example  Work  Products 

1 .  Records  of  analysis  methods  and  results 

Example  Supplier  Deliverables 

1 .  Requirements  and  validation  methods  (e.g.,  prototypes,  simulations) 

Subpractices 

1 .  Analyze  the  requirements  to  determine  the  risk  that  the  resulting 
product  will  not  perform  appropriately  in  its  intended-use  environment. 

2.  Explore  the  adequacy  and  completeness  of  requirements  by 
developing  product  representations  (e.g.,  prototypes,  simulations, 
models,  scenarios,  storyboards)  and  by  obtaining  feedback  about  them 
from  relevant  stakeholders. 

Refer  to  the  Acquisition  Validation  process  area  for  more  information 
about  preparing  for  validation  and  validating  selected  products  and 
product  components. 

3.  Assess  product  and  product  component  solutions  as  they  are 
developed  by  the  supplier  in  the  context  of  the  validation  environment 
to  identify  issues  and  expose  unstated  needs  and  customer 
requirements. 
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ACQUISITION  TECHNICAL  MANAGEMENT 

An  Acquisition  Engineering  Process  Area  at  Maturity  Level  3 


Purpose 


The  purpose  of  Acquisition  Technical  Management  (ATM)  is  to  evaluate  the 
supplier’s  technical  solution  and  to  manage  selected  interfaces  of  that 
solution. 


Introductory  Notes 


The  Acquisition  Technical  Management  process  area  focuses  on  the 
following: 

•  Conducting  technical  reviews  of  the  supplier’s  technical  solution 

•  Analyzing  the  development  and  implementation  of  the  supplier’s 
technical  solution  to  confirm  technical  progress  criteria  or  contractual 
requirements  are  satisfied 

•  Managing  selected  interfaces 

Typically,  these  activities  interactively  support  one  another  to  gauge 
technical  progress  and  allow  effective  management  of  project  technical 
risks.  Different  levels  of  detailed  analysis,  depending  on  the  development 
progress  and  insight  required,  may  be  needed  to  conduct  technical  reviews 
to  the  acquirer’s  satisfaction.  Prototypes,  simulations,  and  technology 
demonstrations  created  by  the  supplier  can  be  used  to  help  gauge  technical 
progress,  gauge  readiness  for  technical  reviews,  assess  technical  risks, 
and  gain  knowledge  needed  to  manage  selected  interfaces. 

In  some  acquisitions,  the  acquirer  assumes  the  role  of  overall  systems 
engineer,  architect,  or  integrator  for  the  product.  In  these  acquisitions,  the 
Technical  Solution  process  area  of  CMMI-DEV  should  also  be  used. 
Technical  Solution  in  CMMI-DEV  includes  additional  information  about 
designing,  developing,  and  implementing  solutions,  including  the  design 
approaches,  design  concepts,  and  alternative  solutions  for  which  an 
acquirer  can  have  varying  degrees  of  responsibility. 

Acquisition  Technical  Management  activities  involve  measuring  technical 
progress  and  the  effectiveness  of  plans  and  requirements.  Activities  include 
the  ones  associated  with  technical  performance  measurement  and  the 
conduct  of  technical  reviews.  A  structured  review  process  should 
demonstrate  and  confirm  completion  of  required  accomplishments  and  exit 
criteria  as  defined  in  project  planning  and  technical  plans  (e.g.,  the  systems 
engineering  management  plan).  Acquisition  Technical  Management 
activities  discover  deficiencies  or  anomalies  that  often  result  in  corrective 
action. 

Acquisition  Technical  Management  should  be  performed  with  other 
technical  and  agreement  management  processes,  such  as  requirements 
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management,  risk  management,  configuration  management,  data 
management,  and  agreement  management. 

For  acquisition  of  product  lines  and  standard  services,  the  practices 
described  in  this  process  area  (as  well  as  Acquisition  Requirements 
Development  practices)  can  also  be  applied  to  identify  and  acquire  core 
assets  used  in  developing,  acquiring,  or  customizing  products  or  service 
systems.  (See  the  definition  of  “product  line”  in  the  glossary.) 

When  the  supplier  is  using  an  Agile  method,  end  users  or  their  proxies  are 
typically  involved  in  the  supplier’s  development  processes.  In  such  a 
situation,  the  acquirer  also  needs  to  be  involved  to  ensure  that  needed 
changes  to  requirements  and  supplier  agreements  are  acceptable  given  the 
constraints  of  the  acquisition,  and  also  to  incorporate  the  changes  into  the 
supplier  agreements. 

Refer  to  the  Plan  Stakeholder  Involvement  specific  practice  in  the  Project 
Planning  process  area  for  more  information  about  supporting  the  use  of 
Agile  methods. 


Related  Process  Areas 


Refer  to  the  Agreement  Management  process  area  for  more  information 
about  satisfying  supplier  agreements. 

Refer  to  the  Acquisition  Requirements  Development  process  area  for  more 
information  about  allocating  contractual  requirements  and  establishing 
operational  concepts  and  scenarios. 

Refer  to  the  Configuration  Management  process  area  for  more  information 
about  controlling  configuration  items. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  establishing  evaluation  criteria  and  selecting  alternative 
solutions. 

Refer  to  the  Plan  Data  Management  specific  practice  in  the  Project 
Planning  process  area  for  more  information  about  managing  data. 

Refer  to  the  Requirements  Management  process  area  for  more  information 
about  managing  requirements. 

Refer  to  the  Risk  Management  process  area  for  more  information  about 
mitigating  risks. 

Specific  Goal  and  Practice  Summary 

SG  1  Evaluate  Technical  Solutions 

SP  1 .1  Select  Technical  Solutions  for  Analysis 

SP  1 .2  Analyze  Selected  Technical  Solutions 

SP1.3  Conduct  Technical  Reviews 
SG  2  Perform  Interface  Management 

SP  2.1  Select  Interfaces  to  Manage 
SP  2.2  Manage  Selected  Interfaces 
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Specific  Practices  by  Goal 


SG  1  Evaluate  Technical  Solutions 

Supplier  technical  solutions  are  evaluated  to  confirm  that  contractual 
requirements  continue  to  be  met. 

Technical  reviews  (e.g.,  architectural  evaluations)  are  performed  throughout 
the  project  lifecycle  to  gain  confidence  that  the  requirements,  architecture, 
and  supplier  technical  solutions  are  capable  of  guiding  a  development  that 
results  in  a  product  or  service  that  provides  the  required  capability.  This 
activity  should  be  integrated  with  risk  management  activities.  Mature 
organizations  typically  perform  technical  reviews  using  different  proven 
techniques  depending  on  the  type  of  review.  They  broaden  the  basis  of  the 
review  to  include  other  stakeholder  needs,  expectations,  and  constraints. 

Refer  to  the  Establish  the  Acquisition  Strategy  specific  practice  in  the 
Project  Planning  process  area  for  more  information  about  specifying 
technical  performance  measures  and  their  threshold  values. 

This  specific  goal  focuses  on  the  following: 

•  Selecting  supplier  technical  solutions  (i.e.,  preliminary  designs,  detailed 
designs,  design  implementations,  delivered  increments  of  component 
functionality)  based  on  sound  decision-making  criteria 

•  Analyzing  selected  supplier  technical  solutions 

•  Conducting  technical  reviews  using  results  of  the  analysis 

SP  1.1  Select  Technical  Solutions  for  Analysis 

Select  supplier  technical  solutions  to  be  analyzed  and  analysis 
methods  to  be  used. 

The  supplier  technical  solutions  are  typically  in  one  of  the  following  three 
stages: 

•  Candidate  solutions  or  preliminary  designs  (includes  consideration  of 
design  approaches,  design  concepts,  architectures,  architectural  styles 
and  patterns,  product  partitions,  major  interfaces,  system  states  and 
modes)  that  potentially  satisfy  an  appropriate  set  of  allocated  functional 
and  quality  attribute  requirements 

•  Detailed  designs  for  selected  solutions  (i.e.,  containing  all  the 
information  needed  to  manufacture,  code,  or  otherwise  implement  the 
design  as  a  product  or  product  component) 

•  Implemented  designs  (i.e.,  the  product  or  service) 

Depending  on  where  in  the  acquisition  lifecycle  the  highest  risks  occur,  the 
acquirer  selects  supplier  technical  solutions  for  analysis  to  reduce  those 
risks.  Analysis  methods  are  selected  based  on  the  type  of  technical  solution 
being  analyzed  and  the  nature  of  the  risk. 


Acquisition  Technical  Management  (ATM) 


99 


CMMI  for  Acquisition,  Version  1.3 


For  example,  in  the  design  phases  of  the  supplier  technical  solution,  quality  attribute  models, 
simulations,  prototypes  or  pilots  can  be  used  to  provide  additional  information  about  the 
properties  of  the  potential  design  solutions  to  aid  in  their  evaluation  and  selection. 
Simulations  can  be  particularly  useful  for  systems-of-systems. 


< - 

|  For  example,  in  the  implementation  phase  of  the  supplier  technical  solution,  the  acquirer  can 

j  examine  a  product  to  determine  if  it  is  ready  for  production  and  if  the  supplier  has 
:  accomplished  adequate  production  planning.  The  analysis  would  determine  if  production  or 
:  production  preparations  incur  unacceptable  risks  that  might  compromise  cost,  schedule, 

:  performance,  or  other  established  objectives.  The  acquirer  might  evaluate  the  full, 
j  production  configured  product  to  determine  if  it  correctly  and  completely  implements  all 
j  contractual  requirements.  The  acquirer  could  also  determine  whether  the  traceability  of  the 
:  final  contractual  requirements  to  the  final  production  configured  product  has  been 
:  maintained. 


The  acquirer  may  also  want  to  select  interfaces  for  analysis  to  help  decide 
which  interfaces  require  acquirer  management.  (See  specific  goal  2  of  this 
process  area.) 

Example  Work  Products 

1 .  Criteria  used  to  select  supplier  technical  solutions  for  analysis 

2.  Lists  of  supplier  technical  solutions  selected  for  analysis 

3.  Analysis  methods  for  each  selected  supplier  solution 
Example  Supplier  Deliverables 

1 .  List  of  supplier  deliverables 
Subpractices 

1 .  Develop  criteria  for  determining  which  supplier  technical  solutions  to 
analyze. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  establishing  evaluation  criteria. 

2.  Identify  supplier  technical  solutions  for  analysis. 

:  Supplier  technical  solutions  that  are  typically  analyzed  by  the  acquirer  include  the 
j  following: 

j  •  Supplier  derived  product  and  product  component  requirements,  architectures,  and 
j  designs 

j  •  Product  interface  descriptions 
i  •  Products  and  product  components 
:  •  Operations  manuals 
i_  •  Plans  for  training  the  operations  staff 

3.  Identify  the  functional  and  quality  attribute  requirements  to  be  satisfied 
by  each  selected  technical  solution. 
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A  traceability  matrix  is  a  useful  tool  for  identifying  requirements  for  each  selected 
technical  solution,  as  it  typically  includes  information  that  relates  requirements  to  work 
products.  When  identifying  requirements  for  each  selected  technical  solution,  consult 
the  appropriate  traceability  matrix. 

Refer  to  the  Maintain  Bidirectional  Traceability  of  Requirements 
specific  practice  in  the  Requirements  Management  process  area  for 
more  information  about  tracing  requirements  to  work  products. 

4.  Identify  the  analysis  methods  to  be  used  for  each  selected  technical 
solution. 

r - 

|  Examples  of  techniques  used  for  analysis  include  the  following: 

■  •  Simulations 
|  •  Prototyping 
i  •  Architecture  evaluation 
i  •  Demonstrations 

5.  Include  analysis  methods  and  review  activities  in  the  project  plan. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
establishing  and  maintaining  plans  that  define  project  activities. 

SP  1.2  Analyze  Selected  Technical  Solutions 

Analyze  selected  supplier  technical  solutions. 

Depending  on  the  type  of  technical  solution  being  analyzed  (i.e.,  preliminary 
design,  detailed  design,  design  implementation  of  components  or  their 
interfaces),  the  results  of  the  analysis  are  provided  to  the  technical  review 
described  in  the  next  specific  practice. 

i  For  example,  the  acquirer  should  assess  the  design  as  it  matures  in  the  context  of  the 
i  requirements  to  identify  issues  and  expose  unstated  needs  and  customer  requirements. 


The  acquirer  should  select  a  supplier’s  design  to  analyze  by  exploring  the 
adequacy  and  completeness  of  that  design  by  reviewing  product 
representations  (e.g.,  prototypes,  simulations,  models,  scenarios, 
storyboards)  and  by  obtaining  feedback  about  them  from  relevant 
stakeholders. 

The  acquirer  should  confirm  the  following: 

•  The  selected  design  adheres  to  applicable  design  standards  and 
criteria. 

•  The  design  adheres  to  allocated  functional  and  quality  attribute 
requirements. 

•  The  resulting  product  will  perform  appropriately  in  its  intended-use 
environment. 

During  design  implementation,  the  supplier  implements  the  design  reviewed 
and  analyzed  by  the  acquirer  by  developing  product  components, 
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integrating  those  components,  conducting  unit  and  integration  testing  of  the 
product,  and  developing  end-user  documentation. 

A  successful  analysis  of  the  supplier’s  implementation  is  predicated  on  the 
acquirer’s  determination  that  the  requirements  are  fully  met  in  the  final 
production  configuration,  that  the  production  capability  forms  a  satisfactory 
basis  for  proceeding  into  pilots  or  full-rate  production,  and  that  the  product 
is  ready  to  be  brought  into  the  acquirer  environment  for  further  integration 
and  acceptance  testing. 

;  Examples  of  success  criteria  for  the  analysis  of  the  supplier’s  detailed  design  prior  to  its 

:  transition  to  design  implementation  include  the  following: 

:  •  The  product  baseline  enables  hardware  fabrication  and  software  coding  to  proceed  with 

i  proper  configuration  management. 

I  •  Adequate  production  processes  and  measures  are  in  place  for  the  project  to  succeed. 

:  •  Risks  are  managed  effectively. 

j  •  The  detailed  design  is  producible  within  the  production  budget. 


The  acquirer  can  require  delivery  of  verification  results  from  the  supplier  of 
the  technical  solution,  as  applicable.  The  suppliers  can  conduct  verifications 
in  an  iterative  fashion,  concurrently  with  the  acquirer’s  technical  analyses, 
or  the  supplier  can  be  required  to  conduct  follow-on  verifications  of 
technical  solutions. 

Typical  expectations  for  verification  addressed  by  the  supplier  agreement  include  the 
following: 

•  List  of  deliverables  and  other  work  products  that  must  be  verified  by  the  supplier 

•  Applicable  standards,  procedures,  methods,  tools 

•  Criteria  for  verification  of  supplier  work  products 

•  Measurements  to  be  collected  and  provided  by  the  supplier  with  regard  to  verification 
activities 

•  Reviews  of  supplier  verification  results  and  corrective  actions  with  the  acquirer 


Examples  of  considerations  for  follow-on  verifications  of  technical  solutions  include  the 
following: 

•  During  the  production  stage  of  the  project,  there  are  changes  in  either  materials  or 
manufacturing  processes. 

•  Production  startup  or  re-start  occurs  after  a  significant  shutdown  period. 

•  Production  starts  up  with  a  new  supplier. 

•  A  manufacturing  site  has  relocated. 


The  acquirer  should  also  confirm  that  sufficient  end-user  documentation 
has  been  developed  and  is  in  alignment  with  the  tested  implementation. 
The  supplier  can  develop  preliminary  versions  of  the  installation, 
operations,  and  maintenance  documentation  in  early  phases  of  the  project 
lifecycle  for  review  by  acquirer  and  relevant  stakeholders. 
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Example  Work  Products 

1 .  Record  of  analysis 

2.  Results  of  analysis 

Example  Supplier  Deliverables 

1 .  Alternative  solutions 

2.  Product  architecture 

3.  Product  component  designs 

4.  Architecture  evaluations 

5.  Unit  and  integration  test  results 

6.  Verification  results 
Subpractices 

1 .  Confirm  that  the  selected  technical  solution  adheres  to  applicable 
standards  and  criteria. 

2.  Confirm  that  the  selected  technical  solution  adheres  to  allocated 
functional  and  quality  attribute  requirements. 

3.  Use  analysis  results  to  compare  actual  performance  measurements  to 
specified  thresholds  of  technical  performance  measures. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  analyzing  measurement  data. 

4.  Conduct  technical  interchange  meetings  as  necessary. 

Technical  interchange  meetings  are  scheduled  meetings  between  the  supplier  and 
acquirer  to  discuss  technical  progress.  These  meetings  are  less  formal  than  the  event- 
driven  technical  reviews  in  the  next  specific  practice.  One  of  the  purposes  of  these 
meetings  is  to  discuss  and  understand  issues  encountered  during  acquirer  analyses  or 
provided  results  of  supplier  verification  activities. 

5.  Confirm  that  the  selected  technical  solution  is  sufficiently  analyzed  and 
meets  entrance  criteria  to  begin  technical  review. 

6.  Review  critical  verification  results  and  data  from  verifications 
conducted  by  the  supplier. 

SP  1.3  Conduct  Technical  Reviews 

Conduct  technical  reviews  with  the  supplier  as  defined  in  the 
supplier  agreement. 

Technical  reviews  are  used  by  the  acquirer  to  confirm  that  products  and 
services  being  developed  or  produced  by  suppliers  meet  end  user  needs 
and  requirements. 

Technical  reviews  should  have  the  following  characteristics: 

•  Are  conducted  when  the  technical  solution  under  development  satisfies 
review  entry  criteria  (i.e.,  event  driven,  not  schedule  driven) 
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•  At  a  minimum,  are  conducted  at  the  transition  from  one  acquisition 
phase  to  the  next  and  at  major  transition  points  of  technical  effort 

•  Have  their  processes  and  requirements  addressed  in  and  required  by 
the  supplier  agreement 

Typically,  the  project’s  technical  plan  (e.g.,  the  systems  engineering  management  plan) 
documents  the  timing,  conduct,  entrance  criteria,  and  success  or  exit  criteria  used  for 
technical  reviews. 


Refer  to  the  Project  Planning  process  area  for  more  information  about 

establishing  and  maintaining  plans  that  define  project  activities. 

Technical  reviews  typically  include  the  following  activities: 

•  Reviewing  the  supplier’s  technical  activities  and  verifying  that  the  supplier’s 
interpretation  and  implementation  of  requirements  are  consistent  with  the  acquirer’s 
interpretation 

•  Ensuring  that  technical  commitments  are  being  met  and  that  technical  issues  are 
communicated  and  resolved  in  a  timely  manner 

•  Obtaining  technical  information  about  the  supplier’s  products 

•  Providing  the  supplier  with  insight  into  customer  and  end  user  expectations  and 
requirements  regarding  functionality  and  quality  attributes 

•  Providing  appropriate  technical  information  and  support  to  the  supplier 


f - 

|  Examples  of  technical  reviews  that  can  be  conducted  include  the  following: 
j  •  Initial  Technical  Review  (ITR) 
j  •  Alternative  System  Review  (ASR) 
i  •  Integrated  Baseline  Review  (IBR) 
i  •  Technology  Readiness  Assessment  (TRA) 
i  •  System  Requirements  Review  (SRR) 
j  •  System  Functional  Review  (SFR) 
j  •  Preliminary  Design  Review  (PDR) 

:  •  Critical  Design  Review  (CDR) 
i  •  Test  Readiness  Review  (TRR) 
i  •  System  Verification  Review  (SVR) 
i  •  Production  Readiness  Review  (PRR) 
j  •  Operational  Test  Readiness  Review  (OTRR) 
j  •  Physical  Configuration  Audit  (PCA) 


Example  Work  Products 

1.  Review  schedule 

2.  Entry  and  exit  criteria 

3.  Review  results 
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4.  Documented  issues  (e.g.,  issues  with  customer  requirements,  product 
and  product  component  requirements,  product  architecture,  product 
design) 

Example  Supplier  Deliverables 

1 .  Progress  reports  and  process,  product,  and  service  level 
measurements 

2.  Technical  performance  measurements 

3.  Review  materials  and  reports 

4.  Action  items  tracked  to  closure 

5.  Documentation  of  product  and  document  deliveries 

Subpractices 

1 .  Identify  participants  for  the  technical  review. 

2.  Conduct  the  technical  review. 

3.  Analyze  and  record  results  of  the  review. 

4.  Use  the  results  of  technical  reviews  to  improve  the  supplier’s  technical 
solution. 

The  results  of  some  reviews  may  require  changes  to  the  supplier  agreement. 

Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  preparing  a  solicitation  package, 
selecting  one  or  more  suppliers  to  deliver  the  product  or  service,  and 
establishing  and  maintaining  the  supplier  agreement. 

SG  2  Perform  Interface  Management 

Selected  interfaces  are  managed. 

Many  integration  and  transition  problems  arise  from  unknown  or 
uncontrolled  aspects  of  both  internal  and  external  interfaces.  Effective 
management  of  interface  requirements,  specifications,  and  designs  helps  to 
ensure  implemented  interfaces  are  complete  and  compatible. 

The  supplier  is  responsible  for  managing  the  interfaces  of  the  product  or 
service  it  is  developing.  However,  the  acquirer  identifies  interfaces  that  it 
will  manage  as  well  (particularly  external  interfaces). 

SP  2.1  Select  Interfaces  to  Manage 

Select  interfaces  to  manage. 

The  interfaces  considered  for  selection  include  all  interfaces  with  other 
products  and  services  in  the  operations  and  support  environment  as  well  as 
environments  for  verification  and  validation  and  services  that  support  those 
environments.  The  acquirer  should  review  all  supplier  interface  data  for 
completeness  to  substantiate  the  complete  coverage  of  all  interfaces  when 
making  the  selection. 
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Example  Work  Products 

1 .  Criteria  to  be  used  in  selecting  acquirer  managed  interfaces 

2.  Categories  of  interfaces 

3.  List  of  interfaces  per  category 

Example  Supplier  Deliverables 

1 .  Interface  description  documents 

2.  Categories  of  interfaces 

3.  List  of  interfaces  per  category 

4.  Mapping  of  interfaces  to  product  components  and  the  product 
integration  environment 

5.  Interface  design  specifications 

6.  Interface  control  documents 

7.  Interface  specification  criteria 

Subpractices 

1 .  Select  the  criteria  to  be  used  for  determining  which  interfaces  the 
acquirer  should  manage. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  establishing  evaluation  criteria. 

2.  Identify  interfaces  that  are  candidates  for  acquirer  management. 

:  Example  criteria  for  interfaces  that  typically  are  the  focus  of  the  acquirer’s 
:  management  include  the  following: 

■  •  The  interface  spans  organizational  boundaries. 

:  •  The  interface  is  mission  critical. 

:  •  The  interface  is  difficult  or  complex  to  manage. 

i  •  Capability,  interoperability,  efficiency,  or  other  key  quality  attribute  issues  are 
i  associated  with  the  interface. 

i  •  The  interface  affects  multiple  acquisition  projects. 

3.  Review  identified  interfaces  against  the  selection  criteria. 

4.  Include  acquirer  managed  interfaces  in  the  project  plan. 

SP  2.2  Manage  Selected  Interfaces 

Manage  selected  interfaces. 

Managing  interfaces  includes  the  maintenance  of  the  consistency  of  the 
interfaces  throughout  the  life  of  the  product,  compliance  with  architectural 
decisions  and  constraints,  and  the  resolution  of  conflict,  noncompliance, 
and  change  issues.  In  a  system-of-systems  environment,  the  management 
of  interfaces  between  products  or  services  acquired  from  suppliers  and 
other  systems  within  the  system  of  systems  is  critical  for  success  of  the 
project. 
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Interface  changes  are  documented,  maintained,  and  readily  accessible. 

Refer  to  the  Acquisition  Requirements  Development  process  area  for  more 
information  about  validating  requirements. 

Refer  to  the  Configuration  Management  process  area  for  more  information 
about  tracking  and  controlling  changes. 

Refer  to  the  Requirements  Management  process  area  for  more  information 
about  managing  requirements  changes. 

Example  Work  Products 

1 .  Table  of  relationships  among  the  supplier’s  product  or  service  and  the 
external  environment 

2.  Updated  interface  description  or  agreement 

Example  Supplier  Deliverables 

1 .  Table  of  relationships  among  the  product  components  and  the  external 
environment  (e.g.,  main  power  supply,  fastening  product,  computer  bus 
system) 

2.  Reports  from  interface  control  working  group  meetings 

3.  Action  items  for  updating  interfaces 

4.  Application  program  interface  (API) 

Subpractices 

1 .  Review  and  analyze  selected  interface  definitions  and  designs. 

2.  Confirm  that  interface  descriptions  adhere  to  allocated  requirements. 

3.  Confirm  the  compatibility  of  selected  interfaces  throughout  the  life  of 
the  product  or  service. 

Confirm  that  interface  descriptions  adhere  to  applicable  standards,  criteria,  and 
interface  requirements  between  the  supplier’s  product  and  acquirer’s  intended 
environment. 

4.  Verify  that  interfaces  have  been  sufficiently  tested  by  the  supplier. 

5.  Verify  that  issues  identified  during  testing  have  been  resolved 
appropriately,  with  product  revisions,  if  necessary. 

6.  Resolve  conflict,  noncompliance,  and  change  issues  for  the  selected 
interfaces. 

7.  Periodically  review  the  adequacy  of  interface  descriptions. 

Once  established,  interface  descriptions  should  be  periodically  reviewed  to  ensure 
there  is  no  deviation  between  existing  descriptions  and  the  products  being  developed, 
processed,  produced,  or  bought. 

The  interface  descriptions  should  be  reviewed  with  relevant  stakeholders  to  avoid 
misinterpretations,  reduce  delays,  and  prevent  the  development  of  interfaces  that  do 
not  work  properly. 
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ACQUISITION  VALIDATION 


An  Acquisition  Engineering  Process  Area  at  Maturity  Level  3 


Purpose 


The  purpose  of  Acquisition  Validation  (AVAL)  is  to  demonstrate  that  an 
acquired  product  or  service  fulfills  its  intended  use  when  placed  in  its 
intended  environment. 


Introductory  Notes 


Validation  demonstrates  that  the  acquired  product  or  service,  as  provided, 
fulfills  its  intended  use.  In  other  words,  validation  ensures  that  the  acquired 
product  or  service  meets  stakeholders’  needs  and  customer  requirements. 

Validation  activities  are  performed  early  (concept/explorations  phases)  and 
incrementally  throughout  the  project  lifecycle  (including  transition  to 
operations  and  sustainment).  These  activities  can  be  applied  to  all  aspects 
of  the  product  and  its  components  in  any  of  their  intended  environments, 
such  as  operations,  training,  manufacturing,  maintenance,  and  support 
services.  (Throughout  the  process  areas,  where  the  terms  “product”  and 
“product  component”  are  used,  their  intended  meanings  also  encompass 
services,  service  systems,  and  their  components.) 

The  product  or  product  components  that  are  selected  to  be  validated  by  the 
acquirer  vary  depending  on  project  attributes.  Methods  used  to  conduct 
validation  also  can  be  applied  to  selected  acquirer  work  products  (e.g., 
customer  requirements)  and  supplier  deliverables  (e.g.,  prototypes, 
simulations,  demonstrations).  Method  selection  is  based  on  which  methods 
best  predict  how  well  the  acquired  product  or  service  will  satisfy  stakeholder 
needs. 

Whenever  possible,  validation  should  be  conducted  using  the  product  or 
product  component  operating  in  its  intended  environment.  Either  the  entire 
environment  or  part  of  it  can  be  used. 

When  validation  issues  are  identified,  these  issues  are  referred  to 
processes  associated  with  the  Acquisition  Requirements  Development  or 
Project  Monitoring  and  Control  process  areas  for  resolution. 

The  specific  practices  of  this  process  area  build  on  each  other  in  the 
following  way: 

•  The  Select  Products  for  Validation  specific  practice  enables  the 
identification  of  the  product  or  product  component  to  be  validated  and 
methods  to  be  used  to  perform  the  validation. 

•  The  Establish  the  Validation  Environment  specific  practice  enables  the 
determination  of  the  environment  to  be  used  to  carry  out  the  validation. 
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•  The  Establish  Validation  Procedures  and  Criteria  specific  practice 
enables  the  development  of  validation  procedures  and  criteria  that  are 
aligned  with  the  characteristics  of  selected  products,  customer 
constraints  on  validation,  methods,  and  the  validation  environment. 

•  The  Perform  Validation  specific  practice  enables  the  validation  to  be 
conducted  according  to  methods,  procedures,  and  criteria. 

•  The  Analyze  Validation  Results  specific  practice  enables  the  analysis  of 
validation  results  against  criteria. 

Related  Process  Areas 


Refer  to  the  Agreement  Management  process  area  for  more  information 
about  accepting  the  acquired  product. 

Refer  to  the  Acquisition  Requirements  Development  process  area  for  more 
information  about  validating  requirements. 

Refer  to  the  Acquisition  Technical  Management  process  area  for  more 
information  about  evaluating  the  supplier’s  technical  solution  and  managing 
selected  interfaces  of  that  solution. 

Specific  Goal  and  Practice  Summary 

SG  1  Prepare  for  Validation 

SP  1 .1  Select  Products  for  Validation 
SP  1.2  Establish  the  Validation  Environment 

SP  1.3  Establish  Validation  Procedures  and  Criteria 
SG  2  Validate  Selected  Products  and  Product  Components 
SP  2.1  Perform  Validation 

SP  2.2  Analyze  Validation  Results 

Specific  Practices  by  Goal 


SG  1  Prepare  for  Validation 

Preparation  for  validation  is  conducted. 

Validation  preparation  activities  include  selecting  products  and  product 
components  for  validation  and  establishing  and  maintaining  the  validation 
environment,  procedures,  and  criteria.  Items  selected  for  validation  may 
include  only  the  product  or  it  may  include  appropriate  levels  of  product 
components  used  to  build  the  product.  Any  product  or  product  component 
may  be  subject  to  validation,  including  replacement,  maintenance,  and 
training  products,  to  name  a  few. 

The  environment  required  to  validate  the  product  or  product  component  is 
prepared.  The  environment  can  be  purchased  or  can  be  specified, 
designed,  and  built.  Environments  used  for  verification  can  be  considered  in 
collaboration  with  the  validation  environment  to  reduce  cost  and  improve 
efficiency  or  productivity. 
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Expectations  for  validation,  which  are  typically  included  in  the  supplier  agreement,  include 

the  following: 

•  List  of  acquired  products  to  be  validated  by  the  acquirer  before  formal  acceptance 

•  List  of  products  to  be  validated  with  customers,  end  users,  or  other  relevant 
stakeholders  by  the  supplier  and  applicable  validation  standards,  procedures,  methods, 
tools  and  criteria,  if  any 

•  Measurements  to  be  collected  and  provided  by  the  supplier  with  regard  to  validation 
activities 

•  Supplier  roles  to  be  taken  in  product  and  product  component  validation 

•  Validation  environments  to  be  used  by  the  acquirer 

•  Validation  procedures  to  be  developed  and  criteria  to  be  used  for  validation 


SP  1.1  Select  Products  for  Validation 

Select  products  and  product  components  to  be  validated  and 
validation  methods  to  be  used. 

Products  and  product  components  are  selected  for  validation  based  on  their 
relationship  to  end-user  needs.  For  each  product  or  product  component,  the 
scope  of  the  validation  (e.g.,  operational  behavior,  maintenance,  training, 
user  interface)  should  be  determined. 

:  Examples  of  products  and  product  components  that  can  be  validated  include  the  following: 
i  •  Customer  requirements  and  design  constraints 

;  •  Acquired  products  and  product  components  (e.g.,  system,  hardware  units,  software, 
i  service  documentation) 

:  •  User  manuals 
:  •  Training  materials 
i  •  Process  documentation 


Validation  methods  should  be  selected  early  in  the  life  of  the  project  so  they 

are  clearly  understood  and  agreed  to  by  relevant  stakeholders. 

Validation  methods  address  the  development,  maintenance,  support,  and 

training  for  the  product  or  product  components  as  appropriate. 

Examples  of  validation  methods  include  the  following: 

•  Discussions  with  end  users,  perhaps  in  the  context  of  a  formal  review 

•  Prototype  demonstrations 

•  Functional  demonstrations  (e.g.,  system,  hardware  units,  software,  service 
documentation,  user  interfaces) 

•  Pilots  of  training  materials 

•  Tests  of  products  and  product  components  by  end  users  and  other  relevant 
stakeholders 

•  End-of-cycle  or  end-of-phase  reviews  (with  customer  or  end  user)  for  incremental  or 
iterative  development 
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Example  Work  Products 

1 .  Lists  of  products  and  product  components  selected  for  validation 

2.  Validation  methods  for  each  product  or  product  component 

3.  Requirements  for  performing  validation  for  each  product  or  product 
component 

4.  Validation  constraints  for  each  product  or  product  component 

Subpractices 

1 .  Identify  the  key  principles,  features,  and  phases  for  product  or  product 
component  validation  throughout  the  life  of  the  project. 

2.  Determine  the  customer  requirements  to  be  validated. 

The  product  or  product  component  should  be  maintainable  and  supportable  in  its 
intended  operational  environment.  This  specific  practice  also  addresses  the  actual 
maintenance,  training,  and  support  services  that  can  be  delivered  with  the  product. 

3.  Select  the  product  and  product  components  to  be  validated. 

4.  Select  the  evaluation  methods  for  product  or  product  component 
validation. 

5.  Review  the  validation  selection,  constraints,  and  methods  with  relevant 
stakeholders. 

SP  1.2  Establish  the  Validation  Environment 

Establish  and  maintain  the  environment  needed  to  support 
validation. 

The  requirements  for  the  validation  environment  are  driven  by  the  product 
or  service  selected,  type  of  work  products  (e.g.,  design,  prototype,  final 
version),  and  validation  methods.  These  selections  can  yield  requirements 
for  the  purchase  or  development  of  equipment,  software,  or  other 
resources.  The  validation  environment  can  include  the  reuse  of  existing 
resources.  In  this  case,  arrangements  should  be  made  for  the  use  of  these 
resources. 


112 


Acquisition  Validation  (AVAL) 


CMMI  for  Acquisition,  Version  1.3 


Example  types  of  elements  in  a  validation  environment  include  the  following: 

•  Test  tools  interfaced  with  the  product  being  validated  (e.g.,  scope,  electronic  devices, 
probes) 

•  Temporary  embedded  test  software 

•  Recording  tools  for  dump  or  further  analysis  and  replay 

•  Simulated  subsystems  or  components  (e.g.,  software,  electronics,  mechanics) 

•  Simulated  interfaced  systems  (e.g.,  a  dummy  warship  for  testing  a  naval  radar) 

•  Real  interfaced  systems  (e.g.,  aircraft  for  testing  a  radar  with  trajectory  tracking 
facilities) 

•  Facilities  and  customer  supplied  products 

•  Skilled  people  to  operate  or  use  all  the  preceding  elements 

•  Dedicated  computing  or  network  test  environment  (e.g.,  pseudo-operational 
telecommunications  network  test  bed  or  facility  with  actual  trunks,  switches,  and 
systems  established  for  realistic  integration  and  validation  trials) 


Early  selection  of  products  or  product  components  to  be  validated,  work 
products  to  be  used  in  validation,  and  validation  methods  is  needed  to 
ensure  that  the  validation  environment  will  be  available  when  necessary. 

The  validation  environment  should  be  carefully  controlled  to  provide  for 
replication,  results  analysis,  and  revalidation  of  problem  areas. 

Example  Work  Products 

1.  Validation  environment 

Subpractices 

1 .  Identify  requirements  for  the  validation  environment. 

2.  Identify  customer  supplied  products. 

3.  Identify  validation  equipment  and  tools. 

4.  Identify  validation  resources  that  are  available  for  reuse  and 
modification. 

5.  Plan  the  availability  of  resources  in  detail. 

SP  1.3  Establish  Validation  Procedures  and  Criteria 

Establish  and  maintain  procedures  and  criteria  for  validation. 

Validation  procedures  and  criteria  are  defined  to  ensure  the  product  or 
product  component  will  fulfill  its  intended  use  when  placed  in  its  intended 
environment.  Acceptance  test  cases  and  procedures  can  be  used  for 
validation  procedures. 

The  validation  procedures  and  criteria  include  validation  of  maintenance, 
training,  and  support  services. 

These  procedures  also  address  the  validation  of  requirements  and  the 
acquired  product  or  service  throughout  the  project  lifecycle.  Typically, 
formal  acceptance  testing  procedures  and  criteria  are  established  to  ensure 
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the  delivered  product  or  service  meets  stakeholder  needs  before  it  is 
deployed  in  the  intended  environment. 

The  validation  procedures  and  criteria  applicable  to  the  supplier  are 
typically  referenced  in  the  solicitation  package  and  supplier  agreement. 

Examples  of  sources  for  validation  criteria  include  the  following: 

•  Business  process  descriptions 

•  Customer  requirements 

•  Customer  acceptance  criteria 

•  Standards 


Example  Work  Products 

1 .  Validation  procedures 

2.  Validation  criteria 

3.  Test  and  evaluation  procedures  for  maintenance,  training,  and  support 

Subpractices 

1 .  Review  the  requirements  to  ensure  that  issues  affecting  validation  of 
the  acquired  product  or  service  are  identified  and  resolved. 

2.  Document  the  environment,  operational  scenario,  procedures,  inputs, 
outputs,  and  criteria  for  the  validation  of  the  acquired  product  or 
service. 

3.  Assess  the  product  or  service  as  it  matures  in  the  context  of  the 
validation  environment  to  identify  validation  issues. 

SG  2 _ Validate  Selected  Products  and  Product  Components _ 

Selected  products  and  product  components  are  validated  to  ensure  they  are 
suitable  for  use  in  their  intended  operating  environment. 

The  validation  methods,  procedures,  criteria,  and  the  environment  are  used 
to  validate  the  selected  products  and  product  components  and  associated 
maintenance,  training,  and  support  services.  Validation  activities  are 
performed  throughout  the  project  lifecycle. 

Validation  activities  are  performed  by  the  acquirer,  the  supplier,  or  both 
parties  in  accordance  with  the  supplier  agreement. 

SP  2.1  Perform  Validation 

Perform  validation  on  selected  products  and  product  components. 

To  be  acceptable  to  stakeholders,  a  product  or  product  component  must 
perform  as  expected  in  its  intended  operational  environment. 

Validation  activities  are  performed  and  the  resulting  data  are  collected 
according  to  established  methods,  procedures,  and  criteria. 

The  as-run  validation  procedures  should  be  documented  and  the  deviations 
occurring  during  the  execution  should  be  noted  as  appropriate. 
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Example  Work  Products 

1 .  Validation  reports 

2.  Validation  results 

3.  Validation  cross  reference  matrix 

4.  As-run  procedures  log 

5.  Operational  demonstrations 

SP  2.2  Analyze  Validation  Results 

Analyze  results  of  validation  activities. 

The  data  resulting  from  validation  tests,  inspections,  demonstrations,  or 
evaluations  are  analyzed  against  defined  validation  criteria.  Analysis  reports 
indicate  whether  needs  were  met.  In  the  case  of  deficiencies,  these  reports 
document  the  degree  of  success  or  failure  and  categorize  probable  causes 
of  failure.  The  collected  test,  inspection,  or  review  results  are  compared 
with  established  acceptance  criteria  to  determine  whether  to  proceed  or  to 
address  requirements  or  design  issues  with  the  supplier. 

Analysis  reports  or  as-run  validation  documentation  may  also  indicate  that 
bad  test  results  are  due  to  a  validation  procedure  problem  or  a  validation 
environment  problem. 

Example  Work  Products 

1 .  Validation  deficiency  reports 

2.  Validation  issues 

3.  Procedure  change  request 

Subpractices 

1 .  Compare  actual  results  to  expected  results. 

2.  Based  on  the  established  validation  criteria,  identify  products  and 
product  components  that  do  not  perform  suitably  in  their  intended 
operating  environments,  or  identify  problems  with  methods,  criteria,  or 
the  environment. 

3.  Analyze  validation  data  for  defects. 

4.  Record  results  of  the  analysis  and  identify  issues. 

5.  Use  validation  results  to  compare  actual  measurements  and  product 
performance  to  the  intended  use  or  operational  need. 

6.  Identify,  document,  and  track  action  items  to  closure  for  work  products 
that  do  not  pass  their  validation. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  managing  corrective  action  to  closure. 
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ACQUISITION  VERIFICATION 


An  Acquisition  Engineering  Process  Area  at  Maturity  Level  3 


Purpose 


The  purpose  of  Acquisition  Verification  (AVER)  is  to  ensure  that  selected 
work  products  meet  their  specified  requirements. 


Introductory  Notes 


Acquisition  verification  addresses  whether  acquirer  work  products  properly 
reflect  specified  requirements. 

The  Acquisition  Verification  process  area  involves  the  following  activities: 

•  Preparing  for  verification 

•  Performing  verification 

•  Identifying  corrective  action 

Verification  is  inherently  an  incremental  process  because  it  occurs 
throughout  the  acquisition  of  the  product  or  service,  beginning  with 
verification  of  requirements  and  plans,  progressing  through  the  verification 
of  evolving  work  products  and  culminating  in  the  verification  of  the 
completed  product. 

The  specific  practices  of  this  process  area  build  on  each  other  in  the 
following  way: 

•  The  Select  Work  Products  for  Verification  specific  practice  enables  the 
identification  of  work  products  to  be  verified,  methods  to  be  used  to 
perform  the  verification,  and  documented  requirements  to  be  satisfied 
by  each  selected  work  product. 

•  The  Establish  the  Verification  Environment  specific  practice  enables  the 
selection  or  creation  of  the  environment  to  be  used  to  carry  out  the 
verification. 

•  The  Establish  Verification  Procedures  and  Criteria  specific  practice 
enables  the  development  of  verification  procedures  and  criteria  that  are 
aligned  with  selected  work  products,  requirements,  methods,  and 
characteristics  of  the  verification  environment. 

•  The  Prepare  for  Peer  Reviews,  Conduct  Peer  Reviews,  and  Analyze 
Peer  Review  Data  specific  practices  enable  the  conduct  of  peer 
reviews,  an  important  type  of  verification  that  is  a  proven  mechanism  for 
effective  defect  removal. 

•  The  Perform  Verification  specific  practice  enables  the  conduct  of 
verification  according  to  established  methods,  procedures,  and  criteria. 

•  The  Analyze  Verification  Results  specific  practice  enables  analysis  of 
verification  results  against  established  criteria. 
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Related  Process  Areas 


Refer  to  the  Acquisition  Requirements  Development  process  area  for  more 
information  about  developing  and  analyzing  customer  and  contractual 
requirements. 

Refer  to  the  Acquisition  Technical  Management  process  area  for  more 
information  about  evaluating  the  supplier’s  technical  solution  and  managing 
selected  interfaces  of  that  solution. 

Refer  to  the  Acquisition  Validation  process  area  for  more  information  about 
demonstrating  that  an  acquired  product  or  service  fulfills  its  intended  use 
when  placed  in  its  intended  environment. 

Refer  to  the  Requirements  Management  process  area  for  more  information 
about  managing  requirements. 

Specific  Goal  and  Practice  Summary 

SG  1  Prepare  for  Verification 

SP  1 .1  Select  Work  Products  for  Verification 
SP  1 .2  Establish  the  Verification  Environment 
SP  1.3  Establish  Verification  Procedures  and  Criteria 
SG  2  Perform  Peer  Reviews 

SP  2.1  Prepare  for  Peer  Reviews 
SP  2.2  Conduct  Peer  Reviews 

SP  2.3  Analyze  Peer  Review  Data 

SG  3  Verify  Selected  Work  Products 
SP  3.1  Perform  Verification 

SP  3.2  Analyze  Verification  Results 

Specific  Practices  by  Goal 


SG  1  Prepare  for  Verification 

Preparation  for  verification  is  conducted. 

Up-front  preparation  is  necessary  to  ensure  that  verification  provisions  are 
embedded  in  contractual  requirements,  constraints,  plans,  and  schedules. 
Verification  includes  the  selection,  inspection,  testing,  analysis,  and 
demonstration  of  acquirer  work  products. 

Verification  methods  include  but  are  not  limited  to  inspections,  peer 
reviews,  audits,  walkthroughs,  analyses,  architecture  evaluations, 
simulations,  testing,  and  demonstrations.  Practices  related  to  peer  reviews 
as  a  verification  method  are  included  in  specific  goal  2. 

Preparation  for  verification  includes  the  definition  of  support  tools,  test 
equipment  and  software,  simulations,  prototypes,  and  facilities. 

SP  1 .1  Select  Work  Products  for  Verification 

Select  work  products  to  be  verified  and  verification  methods  to  be 
used. 

Acquirer  work  products  are  selected  based  on  their  contribution  to  meeting 
project  objectives  and  requirements,  and  to  addressing  project  risks. 
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|  Typical  verification  activities  include  the  review  of  the  solicitation  package,  supplier 
i  agreements  and  plans,  requirements  documents,  design  constraints  developed  by  the 
:  acquirer,  and  other  acquirer  developed  work  products. 


Selection  of  verification  methods  typically  begins  with  the  definition  of 
requirements  to  ensure  that  the  requirements  are  verifiable.  Re-verification 
should  be  addressed  by  verification  methods  to  ensure  that  rework 
performed  on  work  products  does  not  cause  unintended  defects. 

Example  Work  Products 

1 .  Lists  of  work  products  selected  for  verification 

2.  Verification  methods  for  each  selected  work  product 

Subpractices 

1 .  Identify  acquirer  work  products  for  verification. 

2.  Identify  requirements  to  be  satisfied  by  each  selected  work  product. 

A  traceability  matrix  is  a  useful  tool  for  identifying  requirements  for  each  selected  work 
product,  as  it  typically  includes  information  that  relates  requirements  to  work  products. 
When  identifying  requirements  for  each  selected  work  product,  consult  the  traceability 
matrix  maintained  as  part  of  managing  requirements  for  the  project. 

Refer  to  the  Maintain  Bidirectional  Traceability  of  Requirements 
specific  practice  in  the  Requirements  Management  process  area  for 
more  information  about  tracing  requirements  to  work  products. 

3.  Identify  verification  methods  available  for  use. 

4.  Define  verification  methods  to  be  used  for  each  selected  work  product. 

5.  Identify  verification  activities  and  methods  to  be  used  in  the  project 
plan. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
developing  a  project  plan. 

SP  1.2  Establish  the  Verification  Environment 

Establish  and  maintain  the  environment  needed  to  support 
verification. 

An  environment  should  be  established  to  enable  verification  to  take  place. 
The  type  of  environment  required  depends  on  the  work  products  selected 
for  verification  and  the  verification  methods  used.  A  peer  review  may 
require  little  more  than  a  package  of  materials,  reviewers,  and  a  room.  A 
product  test  can  require  simulators,  emulators,  scenario  generators,  data 
reduction  tools,  environmental  controls,  and  interfaces  with  other  systems. 

The  verification  environment  can  be  acquired,  developed,  reused,  modified, 
or  obtained  using  a  combination  of  these  activities,  depending  on  the  needs 
of  the  project. 
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Example  Work  Products 

1.  Verification  environment 

Subpractices 

1 .  Identify  verification  environment  requirements. 

2.  Identify  verification  resources  that  are  available  for  reuse  or 
modification. 

3.  Identify  verification  equipment  and  tools. 

4.  Acquire  verification  support  equipment  and  an  environment  (e.g.,  test 
equipment,  software). 

SP  1.3  Establish  Verification  Procedures  and  Criteria 

Establish  and  maintain  verification  procedures  and  criteria  for  the 
selected  work  products. 

Verification  criteria  are  defined  to  ensure  that  work  products  meet  their 
requirements. 

r - 

j  Examples  of  sources  for  verification  criteria  include  the  following: 

|  •  Standards 
i  •  Organizational  policies 
:•  Types  of  work  products 
:  •  Proposals  and  agreements 


Example  Work  Products 

1 .  Verification  procedures 

2.  Verification  criteria 

Subpractices 

1 .  Generate  a  set  of  comprehensive,  integrated  verification  procedures 
for  work  products  and  commercial  off-the-shelf  products,  as  necessary. 

2.  Develop  and  refine  verification  criteria  as  necessary. 

3.  Identify  the  expected  results,  tolerances  allowed,  and  other  criteria  for 
satisfying  the  requirements. 

4.  Identify  equipment  and  environmental  components  needed  to  support 
verification. 

SG  2  Perform  Peer  Reviews 

Peer  reviews  are  performed  on  selected  work  products. 

Peer  reviews  are  an  important  part  of  verification  and  are  a  proven 
mechanism  for  effective  defect  removal.  An  important  corollary  is  to  develop 
an  understanding  of  work  products  and  the  processes  that  produced  them 
to  help  prevent  defects  and  identify  opportunities. 
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Peer  reviews  are  applied  to  acquirer  developed  work  products.  These 
reviews  involve  a  methodical  examination  of  work  products  by  the 
acquirer’s  peers  to  identify  defects  for  removal  and  to  recommend  other 
changes  that  are  needed. 

r - 

I  Example  work  products  to  be  peer  reviewed  include  the  solicitation  package  and  the  supplier 
i  agreement. 


SP  2.1  Prepare  for  Peer  Reviews 

Prepare  for  peer  reviews  of  selected  work  products. 

Preparation  activities  for  peer  reviews  typically  include  identifying  the  staff 
to  be  invited  to  participate  in  the  peer  review  of  each  work  product; 
identifying  key  reviewers  who  should  participate  in  the  peer  review; 
preparing  and  updating  materials  to  be  used  during  peer  reviews,  such  as 
checklists  and  review  criteria;  and  scheduling  peer  reviews. 

Example  Work  Products 

1 .  Peer  review  schedule 

2.  Selected  work  products  to  be  reviewed 

Subpractices 

1 .  Determine  the  type  of  peer  review  to  be  conducted. 

2.  Establish  and  maintain  checklists  to  ensure  that  work  products  are 
reviewed  consistently. 

3.  Distribute  the  work  product  to  be  reviewed  and  related  information  to 
participants  early  enough  to  enable  them  to  adequately  prepare  for  the 
peer  review. 

4.  Assign  roles  for  the  peer  review  as  appropriate. 

SP  2.2  Conduct  Peer  Reviews 

Conduct  peer  reviews  of  selected  work  products  and  identify 
issues  resulting  from  these  reviews. 

One  of  the  purposes  of  conducting  a  peer  review  is  to  find  and  remove 
defects  early.  Peer  reviews  are  performed  incrementally  as  work  products 
are  being  developed.  These  reviews  are  structured  and  are  not 
management  reviews. 

Example  Work  Products 

1.  Peer  review  results 

2.  Peer  review  issues 

3.  Peer  review  data 

Subpractices 

1 .  Perform  the  assigned  roles  in  the  peer  review. 

2.  Identify  and  document  defects  and  other  issues  in  the  work  product. 

3.  Record  results  of  the  peer  review,  including  action  items. 
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4.  Collect  peer  review  data. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  obtaining  measurement  data. 

5.  Identify  action  items  and  communicate  issues  to  relevant  stakeholders. 

6.  Conduct  an  additional  peer  review  if  needed. 

SP  2.3  Analyze  Peer  Review  Data 

Analyze  data  about  the  preparation,  conduct,  and  results  of  the 
peer  reviews. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  obtaining  measurement  data. 

Example  Work  Products 

1 .  Peer  review  data 

2.  Peer  review  action  items 

Subpractices 

1 .  Record  data  related  to  the  preparation,  conduct,  and  results  of  the  peer 
reviews. 

2.  Analyze  the  peer  review  data. 

SG  3 _ Verify  Selected  Work  Products _ 

Selected  work  products  are  verified  against  their  specified  requirements. 

Verification  methods,  procedures,  criteria  and  the  environment  are  used  to 
verify  selected  work  products  and  associated  maintenance,  training,  and 
support  services.  Verification  activities  should  be  performed  throughout  the 
project  lifecycle.  Practices  related  to  peer  reviews  as  a  verification  method 
are  included  in  specific  goal  2. 

SP  3.1  Perform  Verification 

Perform  verification  on  selected  work  products. 

Verifying  work  products  incrementally  promotes  early  detection  of  problems 
and  can  result  in  the  early  removal  of  defects.  The  results  of  verification 
save  the  considerable  cost  of  fault  isolation  and  rework  associated  with 
troubleshooting  problems. 

Example  Work  Products 

1 .  Verification  results 

2.  Verification  reports 

3.  Demonstrations 

4.  As-run  procedures  log 

Subpractices 

1 .  Perform  the  verification  of  selected  work  products  against  their 
requirements. 
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2.  Record  the  results  of  verification  activities. 

3.  Identify  action  items  resulting  from  the  verification  of  work  products. 

4.  Document  the  “as-run”  verification  method  and  deviations  from 
established  methods  and  procedures  discovered  during  its 
performance. 

SP  3.2  Analyze  Verification  Results 

Analyze  results  of  all  verification  activities. 

Actual  results  should  be  compared  to  established  verification  criteria  to 
determine  acceptability. 

The  results  of  the  analysis  of  verification  results  are  recorded  as  evidence 
that  verification  was  conducted.  The  acquirer  might  consult  supplier  work 
product  verification  results  and  reports  to  conduct  verification  activities  of 
acquirer  work  products. 

Refer  to  the  Acquisition  Technical  Management  process  area  for  more 
information  about  evaluating  the  supplier’s  technical  solution  and  managing 
selected  interfaces  of  that  solution. 

For  each  work  product,  all  available  verification  results  are  incrementally 
analyzed  and  corrective  actions  are  initiated  to  ensure  that  documented 
requirements  have  been  met.  Corrective  actions  are  typically  integrated  into 
project  monitoring  activities.  Since  a  peer  review  is  one  of  several 
verification  methods,  peer  review  data  should  be  included  in  this  analysis 
activity  to  ensure  that  verification  results  are  analyzed  sufficiently. 

Analysis  reports  or  “as-run”  method  documentation  may  also  indicate  that 
bad  verification  results  are  due  to  method  problems,  criteria  problems,  or 
verification  environment  problems. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  taking  corrective  action. 

Example  Work  Products 

1 .  Analysis  report  (e.g.,  statistics  on  work  product  performance,  causal 
analysis  of  nonconformances,  comparison  of  the  behavior  between  the 
real  product  and  models,  trends) 

2.  Trouble  reports 

3.  Change  requests  for  verification  methods,  criteria,  and  the  environment 

Example  Supplier  Deliverables 

1 .  Verification  results 

2.  Verification  reports 
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Subpractices 

1 .  Compare  actual  results  to  expected  results. 

2.  Based  on  the  established  verification  criteria,  identify  products  that  do 
not  meet  their  requirements  or  identify  problems  with  methods, 
procedures,  criteria,  and  the  verification  environment. 

3.  Analyze  the  defect  data. 

4.  Record  all  results  of  the  analysis  in  a  report. 

5.  Provide  information  on  how  defects  can  be  resolved  (including 
verification  methods,  criteria,  and  verification  environment)  and 
formalize  it  in  a  plan. 
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CAUSAL  ANALYSIS  AND  RESOLUTION 

A  Support  Process  Area  at  Maturity  Level  5 


Purpose 


The  purpose  of  Causal  Analysis  and  Resolution  (CAR)  is  to  identify  causes 
of  selected  outcomes  and  take  action  to  improve  process  performance. 


Introductory  Notes 


Causal  analysis  and  resolution  improves  quality  and  productivity  by 
preventing  the  introduction  of  defects  or  problems  and  by  identifying  and 
appropriately  incorporating  the  causes  of  superior  process  performance. 

The  Causal  Analysis  and  Resolution  process  area  involves  the  following 
activities: 

•  Identifying  and  analyzing  causes  of  selected  outcomes.  The  selected 
outcomes  can  represent  defects  and  problems  that  can  be  prevented 
from  happening  in  the  future  or  successes  that  can  be  implemented  in 
projects  or  the  organization. 

•  Taking  actions  to  complete  the  following: 

o  Remove  causes  and  prevent  the  recurrence  of  those  types  of 
defects  and  problems  in  the  future 

o  Proactively  analyze  data  to  identify  potential  problems  and  prevent 
them  from  occurring 

o  Incorporate  the  causes  of  successes  into  the  process  to  improve 
future  process  performance 

Reliance  on  detecting  defects  and  problems  after  they  have  been 
introduced  is  not  cost  effective.  It  is  more  effective  to  prevent  defects  and 
problems  by  integrating  Causal  Analysis  and  Resolution  activities  into  each 
phase  of  the  project. 

Since  similar  outcomes  may  have  been  previously  encountered  in  other 
projects  or  in  earlier  phases  or  tasks  of  the  current  project,  Causal  Analysis 
and  Resolution  activities  are  mechanisms  for  communicating  lessons 
learned  among  projects. 

Types  of  outcomes  encountered  are  analyzed  to  identify  trends.  Based  on 
an  understanding  of  the  defined  process  and  how  it  is  implemented,  root 
causes  of  these  outcomes  and  future  implications  of  them  are  determined. 

Since  it  is  impractical  to  perform  causal  analysis  on  all  outcomes,  targets 
are  selected  by  tradeoffs  on  estimated  investments  and  estimated  returns 
of  quality,  productivity,  and  cycle  time. 

Measurement  and  analysis  processes  should  already  be  in  place.  Existing 
defined  measures  can  be  used,  though  in  some  instances  new 
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measurement  definitions,  redefinitions,  or  clarified  definitions  may  be 
needed  to  analyze  the  effects  of  a  process  change. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  aligning  measurement  and  analysis  activities  and  providing 
measurement  results. 

Causal  Analysis  and  Resolution  activities  provide  a  mechanism  for  projects 
to  evaluate  their  processes  at  the  local  level  and  look  for  improvements  that 
can  be  implemented. 

Causal  Analysis  and  Resolution  activities  also  include  the  evaluation  of 
acquirer  processes  that  interface  with  supplier  processes  as  appropriate.  A 
jointly  performed  causal  analysis  can  lead  to  such  improvement  actions  as 
the  supplier  improving  its  processes  to  more  effectively  execute  in  the 
context  of  the  project  or  the  acquirer  improving  its  supplier  interfaces. 

When  improvements  are  judged  to  be  effective,  the  information  is  submitted 
to  the  organizational  level  for  potential  deployment  in  the  organizational 
processes. 

The  specific  practices  of  this  process  area  apply  to  a  process  that  is 
selected  for  quantitative  management.  Use  of  the  specific  practices  of  this 
process  area  can  add  value  in  other  situations,  but  the  results  may  not 
provide  the  same  degree  of  impact  to  the  organization’s  quality  and  process 
performance  objectives. 


Related  Process  Areas 


Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  aligning  measurement  and  analysis  activities  and  providing 
measurement  results. 


Refer  to  the  Organizational  Performance  Management  process  area  for 
more  information  about  selecting  and  implementing  improvements  for 
deployment. 

Refer  to  the  Quantitative  Project  Management  process  area  for  more 
information  about  quantitatively  managing  the  project  to  achieve  the 
project’s  established  quality  and  process  performance  objectives. 


Specific  Goal  and  Practice  Summary 

SG  1  Determine  Causes  of  Selected  Outcomes 
SP  1 .1  Select  Outcomes  for  Analysis 
SP1.2  Analyze  Causes 
SG  2  Address  Causes  of  Selected  Outcomes 
SP2.1  Implement  Action  Proposals 
SP  2.2  Evaluate  the  Effect  of  Implemented  Actions 
SP  2.3  Record  Causal  Analysis  Data 
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Specific  Practices  by  Goal 


SG  1 _ Determine  Causes  of  Selected  Outcomes _ 

Root  causes  of  selected  outcomes  are  systematically  determined. 

A  root  cause  is  an  initiating  element  in  a  causal  chain  which  leads  to  an 
outcome  of  interest. 

SP  1 .1  Select  Outcomes  for  Analysis 

Select  outcomes  for  analysis. 

This  activity  could  be  triggered  by  an  event  (reactive)  or  could  be  planned 
periodically,  such  as  at  the  beginning  of  a  new  phase  or  task  (proactive). 

Example  Work  Products 

1 .  Data  to  be  used  in  the  initial  analysis 

2.  Initial  analysis  results  data 

3.  Outcomes  selected  for  further  analysis 

Subpractices 

1 .  Gather  relevant  data. 

:  Examples  of  relevant  data  include  the  following: 

:  •  Defects  reported  by  customers  or  end  users 
:  •  Defects  reported  by  the  supplier 
:  •  Productivity  measures  that  are  higher  than  expected 
:  •  Project  management  problem  reports  requiring  corrective  action 
j  •  Process  capability  problems 

j  •  Earned  value  measurements  by  process  (e.g.,  cost  performance  index) 
j  •  Resource  throughput,  utilization,  or  response  time  measurements 
:  •  Service  fulfillment  or  service  satisfaction  problems 

2.  Determine  which  outcomes  to  analyze  further. 

When  determining  which  outcomes  to  analyze  further,  consider  their  source,  impact, 
frequency  of  occurrence,  similarity,  the  cost  of  analysis,  the  time  and  resources 
needed,  safety  considerations,  etc. 

i - 

j  Examples  of  methods  for  selecting  outcomes  include  the  following: 
j  •  Pareto  analysis 
j  •  Histograms 

j  •  Box  and  whisker  plots  for  attributes 
:  •  Failure  mode  and  effects  analysis  (FMEA) 
i  •  Process  capability  analysis 

3.  Formally  define  the  scope  of  the  analysis,  including  a  clear  definition  of 
the  improvement  needed  or  expected,  stakeholders  affected,  target 
affected,  etc. 
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Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal 
evaluation  process  that  evaluates  identified  alternatives  against 
established  criteria. 

SP  1.2  Analyze  Causes 

Perform  causal  analysis  of  selected  outcomes  and  propose  actions 
to  address  them. 

The  purpose  of  this  analysis  is  to  define  actions  that  will  address  selected 
outcomes  by  analyzing  relevant  outcome  data  and  producing  action 
proposals  for  implementation. 

Example  Work  Products 

1 .  Root  cause  analysis  results 

2.  Action  proposal 

Example  Supplier  Deliverables 

1 .  Root  cause  analysis  results 

2.  Recommended  action  proposals 

Subpractices 

1 .  Conduct  causal  analysis  with  those  who  are  responsible  for  performing 
the  task. 

Causal  analysis  is  performed,  typically  in  meetings,  with  those  who  understand  the 
selected  outcome  under  study.  Those  who  have  the  best  understanding  of  the 
selected  outcome  are  typically  those  who  are  responsible  for  performing  the  task.  The 
analysis  is  most  effective  when  applied  to  real  time  data,  as  close  as  possible  to  the 
event  which  triggered  the  outcome. 

I  Examples  of  when  to  perform  causal  analysis  include  the  following: 

i  •  When  a  stable  subprocess  does  not  meet  its  specified  quality  and  process 
:  performance  objectives,  or  when  a  subprocess  needs  to  be  stabilized 

i  •  During  the  task,  if  and  when  problems  warrant  a  causal  analysis  meeting 
:  •  When  a  work  product  exhibits  an  unexpected  deviation  from  its  requirements 

:  •  When  more  defects  than  anticipated  escape  from  earlier  phases  to  the  current 
:  phase 

j  •  When  process  performance  exceeds  expectations 
j  •  At  the  start  of  a  new  phase  or  task 

Refer  to  the  Quantitative  Project  Management  process  area  for  more 
information  about  performing  root  cause  analysis. 

2.  Analyze  selected  outcomes  to  determine  their  root  causes. 

Analysis  of  process  performance  baselines  and  models  can  aid  in  the  identification  of 
potential  root  causes. 
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Depending  on  the  type  and  number  of  outcomes,  it  can  be  beneficial  to  look  at  the 
outcomes  in  several  ways  to  ensure  all  potential  root  causes  are  investigated. 
Consider  looking  at  individual  outcomes  as  well  as  grouping  the  outcomes. 

i  Examples  of  methods  to  determine  root  causes  include  the  following: 

:  •  Cause-and-effect  (fishbone)  diagrams 
:  •  Check  sheets 

i _ 


3.  Combine  selected  outcomes  into  groups  based  on  their  root  causes. 
In  some  cases,  outcomes  can  be  influenced  by  multiple  root  causes. 

i  Examples  of  cause  groups  or  categories  include  the  following: 

:  •  Inadequate  training  and  skills 
i  •  Breakdown  of  communication 
j  •  Not  accounting  for  all  details  of  a  task 
|  •  Making  mistakes  in  manual  procedures  (e.g.,  keyboard  entry) 

:  •  Process  deficiency 
i  •  Inadequate  resource  allocation 

i  •  Incomplete,  ambiguous,  or  unclear  contractual  requirements 
i  •  Ineffective  management  of  changes  to  the  supplier  agreement 


Where  appropriate,  look  for  trends  or  symptoms  in  or  across  groupings. 

4.  Create  an  action  proposal  that  documents  actions  to  be  taken  to 
prevent  the  future  occurrence  of  similar  outcomes  or  to  incorporate 
best  practices  into  processes. 

Process  performance  models  can  support  cost  benefit  analysis  of  action  proposals 
through  prediction  of  impacts  and  return  on  investment. 

:  Examples  of  proposed  preventative  actions  include  changes  to  the  following: 
i  •  The  process  in  question 
:  •  Training 
:  •  Tools 
:  •  Methods 
i  •  Work  products 

j  Examples  of  incorporating  best  practices  include  the  following: 

i  •  Creating  activity  checklists,  which  reinforce  training  or  communications  related  to 
:  common  problems  and  techniques  for  preventing  them 

:  •  Changing  a  process  so  that  error-prone  steps  do  not  occur 
:  •  Automating  all  or  part  of  a  process 
:  •  Reordering  process  activities 

i  •  Adding  process  steps,  such  as  task  kickoff  meetings  to  review  common  problems 
|  as  well  as  actions  to  prevent  them 
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An  action  proposal  usually  documents  the  following: 

•  Originator  of  the  action  proposal 

•  Description  of  the  outcome  to  be  addressed 

•  Description  of  the  cause 

•  Cause  category 

•  Phase  identified 

•  Description  of  the  action 

•  Time,  cost,  and  other  resources  required  to  implement  the  action  proposal 

•  Expected  benefits  from  implementing  the  action  proposal 

•  Estimated  cost  of  not  fixing  the  problem 

•  Action  proposal  category 


SG  2 _ Address  Causes  of  Selected  Outcomes _ 

Root  causes  of  selected  outcomes  are  systematically  addressed. 

Projects  operating  according  to  a  well-defined  process  systematically 
analyze  where  improvements  are  needed  and  implement  process  changes 
to  address  root  causes  of  selected  outcomes. 

SP  2.1  Implement  Action  Proposals 

Implement  selected  action  proposals  developed  in  causal  analysis. 

Action  proposals  describe  tasks  necessary  to  address  root  causes  of 
analyzed  outcomes  to  prevent  or  reduce  the  occurrence  or  recurrence  of 
negative  outcomes,  or  incorporate  realized  successes.  Action  plans  are 
developed  and  implemented  for  selected  action  proposals.  Only  changes 
that  prove  to  be  of  value  should  be  considered  for  broad  implementation. 

Example  Work  Products 

1 .  Action  proposals  selected  for  implementation 

2.  Action  plans 

Example  Supplier  Deliverables 

1 .  Improvement  proposals 

Subpractices 

1 .  Analyze  action  proposals  and  determine  their  priorities. 

r - - 

|  Criteria  for  prioritizing  action  proposals  include  the  following: 

■  •  Implications  of  not  addressing  the  outcome 
|  •  Cost  to  implement  process  improvements  to  address  the  outcome 
:  •  Expected  impact  on  quality 

Process  performance  models  can  be  used  to  help  identify  interactions  among  multiple 
action  proposals. 

2.  Select  action  proposals  to  be  implemented. 
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SP  2.2 


Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal 
evaluation  process  that  evaluates  identified  alternatives  against 
established  criteria. 

3.  Create  action  plans  for  implementing  the  selected  action  proposals. 

i - 

|  Examples  of  information  provided  in  an  action  plan  include  the  following: 

|  •  Person  responsible  for  implementation 
I  •  Detailed  description  of  the  improvement 
:  •  Description  of  the  affected  areas 
:  •  People  who  are  to  be  kept  informed  of  status 
i  •  Schedule 
:  •  Cost  expended 

:  •  Next  date  that  status  will  be  reviewed 
:  •  Rationale  for  key  decisions 
i  •  Description  of  implementation  actions 

i  •  Time  and  cost  required  to  identify  the  defect  or  problem  and  to  correct  it 
I  •  Estimated  cost  of  not  fixing  the  problem 

4.  Implement  action  plans. 

To  implement  action  plans,  the  following  tasks  should  be  performed: 

•  Make  assignments. 

•  Coordinate  the  people  doing  the  work. 

•  Review  the  results. 

•  Track  action  items  to  closure. 

Experiments  may  be  conducted  for  particularly  complex  changes. 

I  Examples  of  experiments  include  the  following: 
i  •  Using  a  temporarily  modified  process 
i  •  Using  a  new  tool 

Actions  may  be  assigned  to  members  of  the  causal  analysis  team,  members  of  the 
project  team,  or  other  members  of  the  organization. 

5.  Look  for  similar  causes  that  may  exist  in  other  processes  and  work 
products  and  take  action  as  appropriate. 

Evaluate  the  Effect  of  Implemented  Actions 

Evaluate  the  effect  of  implemented  actions  on  process 
performance. 

Refer  to  the  Quantitative  Project  Management  process  area  for  more 
information  about  selecting  measures  and  analytic  techniques. 
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Once  the  changed  process  is  deployed  across  the  project,  the  effect  of 
changes  is  evaluated  to  verify  that  the  process  change  has  improved 
process  performance. 

Example  Work  Products 

1 .  Analysis  of  process  performance  and  change  in  process  performance 

Example  Supplier  Deliverables 

1 .  Base  and  derived  supplier  measurements 

Subpractices 

1 .  Measure  and  analyze  the  change  in  process  performance  of  the 
project’s  affected  processes  or  subprocesses. 

This  subpractice  determines  whether  the  selected  change  has  positively  influenced 
process  performance  and  by  how  much. 

Statistical  and  other  quantitative  techniques  (e.g.,  hypothesis  testing)  can  be  used  to 
compare  the  before  and  after  baselines  to  assess  the  statistical  significance  of  the 
change. 

2.  Determine  the  impact  of  the  change  on  achieving  the  project’s  quality 
and  process  performance  objectives. 

This  subpractice  determines  whether  the  selected  change  has  positively  influenced  the 
ability  of  the  project  to  meet  its  quality  and  process  performance  objectives  by 
understanding  how  changes  in  the  process  performance  data  have  affected  the 
objectives.  Process  performance  models  can  aid  in  the  evaluation  through  prediction 
of  impacts  and  return  on  investment. 

3.  Determine  and  document  appropriate  actions  if  the  process  or 
subprocess  improvements  did  not  result  in  expected  project  benefits. 

SP  2.3  Record  Causal  Analysis  Data 

Record  causal  analysis  and  resolution  data  for  use  across  projects 
and  the  organization. 


Example  Work  Products 

1 .  Causal  analysis  and  resolution  records 

2.  Organizational  improvement  proposals 

Subpractices 

1 .  Record  causal  analysis  data  and  make  the  data  available  so  that  other 
projects  can  make  appropriate  process  changes  and  achieve  similar 
results. 

Record  the  following: 

•  Data  on  outcomes  that  were  analyzed 

•  Rationale  for  decisions 

•  Action  proposals  from  causal  analysis  meetings 

•  Action  plans  resulting  from  action  proposals 


132 


Causal  Analysis  and  Resolution  (CAR) 


CMMI  for  Acquisition,  Version  1.3 


•  Cost  of  analysis  and  resolution  activities 

•  Measures  of  changes  to  the  process  performance  of  the  defined  process 
resulting  from  resolutions 

2.  Submit  process  improvement  proposals  for  the  organization  when  the 
implemented  actions  are  effective  for  the  project  as  appropriate. 

When  improvements  are  judged  to  be  effective,  the  information  can  be  submitted  to 
the  organizational  level  for  potential  inclusion  in  the  organizational  processes. 

Refer  to  the  Organizational  Performance  Management  process  area 
for  more  information  about  selecting  improvements. 
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CONFIGURATION  MANAGEMENT 

A  Support  Process  Area  at  Maturity  Level  2 


Purpose 


The  purpose  of  Configuration  Management  (CM)  is  to  establish  and 
maintain  the  integrity  of  work  products  using  configuration  identification, 
configuration  control,  configuration  status  accounting,  and  configuration 
audits. 


Introductory  Notes 


The  Configuration  Management  process  area  involves  the  following 
activities: 

•  Identifying  the  configuration  of  selected  work  products  that  compose 
baselines  at  given  points  in  time 

•  Controlling  changes  to  configuration  items 

•  Building  or  providing  specifications  to  build  work  products  from  the 
configuration  management  system 

•  Maintaining  the  integrity  of  baselines 

•  Providing  accurate  status  and  current  configuration  data  to  developers, 
end  users,  and  customers 

The  work  products  placed  under  configuration  management  include  the 
products  that  are  delivered  to  the  customer,  designated  internal  work 
products,  acquired  products,  tools,  and  other  items  used  in  creating  and 
describing  these  work  products.  (See  the  definition  of  “configuration 
management”  in  the  glossary.) 

Acquired  products  may  need  to  be  placed  under  configuration  management 
by  both  the  supplier  and  the  acquirer.  Provisions  for  conducting 
configuration  management  should  be  established  in  supplier  agreements. 
Methods  to  ensure  that  data  are  complete  and  consistent  should  be 
established  and  maintained. 

The  configuration  management  approach  depends  on  acquisition  factors 
such  as  acquisition  approach,  number  of  suppliers,  design  responsibility, 
support  concept,  and  associated  costs  and  risks.  In  any  case,  configuration 
management  involves  interaction  between  the  acquirer  and  supplier. 

Planning  for  managing  configuration  items,  including  during  the  transition  to 
operations  and  support,  is  addressed  as  part  of  project  planning  and 
supplier  agreement  development  to  avoid  unexpected  costs  for  both  the 
acquirer  and  supplier.  Project  plans  and  supplier  agreements  should  make 
provisions  for  managing  configuration  items  in  and  across  project  teams 
and  the  infrastructure  required  to  manage  configuration  items  among  the 
acquirer,  supplier,  operational  users,  and  other  relevant  stakeholders. 
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For  example,  there  are  shared  responsibilities  between  the  acquirer  and  supplier  for  the 
technical  solution.  The  acquirer  maintains  configuration  control  of  the  contractual 
requirements  and  the  supplier  performs  configuration  management  for  the  technical  solution 
(e.g.,  establish  and  maintain  the  product  baseline). 

In  this  example,  the  acquirer  retains  the  authority  and  responsibility  for  approving  design 
changes  that  affect  the  product’s  ability  to  meet  contractual  requirements.  The  supplier 
manages  other  design  changes.  The  acquirer  maintains  the  right  to  access  configuration 
data  at  any  level  required  to  implement  planned  or  potential  design  changes  and  support 
options.  Configuration  management  of  legacy  systems  should  be  addressed  on  a  case-by- 
case  basis  as  design  changes  are  contemplated. 


Examples  of  work  products  that  can  be  placed  under  configuration  management  include  the 
following: 

•  Hardware  and  equipment 

•  Acquisition  strategies 

•  Solicitation  packages 

•  Supplier  agreements 

•  Supplier  deliverables 

•  Plans 

•  Process  descriptions 

•  Requirements 

•  Tool  configurations 


Configuration  management  of  work  products  can  be  performed  at  several 
levels  of  granularity.  Configuration  items  can  be  decomposed  into 
configuration  components  and  configuration  units.  Only  the  term 
“configuration  item”  is  used  in  this  process  area.  Therefore,  in  these 
practices,  “configuration  item”  may  be  interpreted  as  “configuration 
component”  or  “configuration  unit”  as  appropriate.  (See  the  definition  of 
“configuration  item”  in  the  glossary.) 

Baselines  provide  a  stable  basis  for  the  continuing  evolution  of 
configuration  items. 

:  An  example  of  an  acquirer’s  baseline  is  a  collection  of  acquirer  work  products  such  as 
:  contractual  requirements  and  acceptance  criteria  that  are  related  to  the  product  baseline 
j  managed  by  the  supplier. 


Baselines  are  added  to  the  configuration  management  system  as  they  are 
developed.  Changes  to  baselines  and  the  release  of  work  products  built 
from  the  configuration  management  system  are  systematically  controlled 
and  monitored  via  the  configuration  control,  change  management,  and 
configuration  auditing  functions  of  configuration  management. 

This  process  area  applies  not  only  to  configuration  management  on  projects 
but  also  to  configuration  management  of  organizational  work  products  such 
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as  standards,  procedures,  reuse  libraries,  and  other  shared  supporting 
assets. 

Configuration  management  is  focused  on  the  rigorous  control  of  the 
managerial  and  technical  aspects  of  work  products,  including  the  delivered 
product  or  service. 

This  process  area  covers  the  practices  for  performing  the  configuration 
management  function  and  is  applicable  to  all  work  products  that  are  placed 
under  configuration  management. 

For  acquisition  of  product  lines  and  standard  services,  configuration 
management  can  involve  additional  considerations  due  to  the  sharing  of 
core  assets  across  acquisitions  (and  perhaps  organizations)  and  across 
multiple  versions  of  core  assets.  In  such  a  case,  the  configuration 
management  approach  and  specific  responsibilities  should  be  specified  in 
supplier  and  customer  agreements.  (See  the  definition  of  “product  line”  in 
the  glossary.) 

Related  Process  Areas 


Refer  to  the  Agreement  Management  process  area  for  more  information 
about  accepting  the  acquired  product. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  the  project  against  the  plan  and  managing 
corrective  action  to  closure. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
developing  a  project  plan. 

Specific  Goal  and  Practice  Summary 

SG  1  Establish  Baselines 

SP1.1  Identify  Configuration  Items 
SP  1 .2  Establish  a  Configuration  Management  System 
SP  1 .3  Create  or  Release  Baselines 
SG  2  Track  and  Control  Changes 

SP  2.1  Track  Change  Requests 
SP  2.2  Control  Configuration  Items 
SG  3  Establish  Integrity 

SP  3.1  Establish  Configuration  Management  Records 
SP  3.2  Perform  Configuration  Audits 

Specific  Practices  by  Goal 


SG  1  Establish  Baselines 

Baselines  of  identified  work  products  are  established. 

Specific  practices  to  establish  baselines  are  covered  by  this  specific  goal. 
The  specific  practices  under  the  Track  and  Control  Changes  specific  goal 
serve  to  maintain  the  baselines.  The  specific  practices  of  the  Establish 
Integrity  specific  goal  document  and  audit  the  integrity  of  the  baselines. 


Configuration  Management  (CM) 


137 


CMMI  for  Acquisition,  Version  1.3 


SP  1.1  Identify  Configuration  Items 

Identify  configuration  items,  components,  and  related  work 
products  to  be  placed  under  configuration  management. 

Configuration  identification  is  the  selection  and  specification  of  the 
following: 

•  Products  delivered  to  the  customer 

•  Designated  internal  work  products 

•  Acquired  products 

•  Tools  and  other  capital  assets  of  the  project’s  work  environment 

•  Other  items  used  in  creating  and  describing  these  work  products 

Configuration  items  can  include  hardware,  equipment,  and  tangible  assets 
as  well  as  software  and  documentation.  Documentation  can  include 
requirements  specifications  and  interface  documents.  Other  documents  that 
serve  to  identify  the  configuration  of  the  product  or  service,  such  as  test 
results,  may  also  be  included. 

A  “configuration  item”  is  an  entity  designated  for  configuration  management, 
which  may  consist  of  multiple  related  work  products  that  form  a  baseline. 
This  logical  grouping  provides  ease  of  identification  and  controlled  access. 
The  selection  of  work  products  for  configuration  management  should  be 
based  on  criteria  established  during  planning. 

Configuration  items  can  vary  widely  in  complexity,  size,  and  type,  from  an 
aircraft  to  commercial  off-the-shelf  software  to  a  test  meter  or  a  project  plan. 
Any  item  required  for  product  support  and  designated  for  separate 
procurement  is  a  configuration  item.  Acquirer  work  products  provided  to 
suppliers  such  as  solicitation  packages  and  technical  standards  are 
typically  designated  as  configuration  items. 

Example  Work  Products 

1.  Identified  configuration  items 

Subpractices 

1 .  Select  configuration  items  and  work  products  that  compose  them 
based  on  documented  criteria. 

i  Example  criteria  for  selecting  configuration  items  at  the  appropriate  work  product  level 
:  include  the  following: 

j  •  Work  products  that  can  be  used  by  two  or  more  groups 

|  •  Work  products  that  are  expected  to  change  over  time  either  because  of  errors  or 
changes  in  requirements 

;  •  Work  products  that  are  dependent  on  each  other  (i.e.,  a  change  in  one  mandates  a 
:  change  in  the  others) 

:  •  Work  products  critical  to  project  success 
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Examples  of  acquirer  work  products  and  supplier  deliverables  that  may  be  part  of  a 
configuration  item  include  the  following: 

•  Acceptance  criteria 

•  Supplier  project  progress  and  performance  reports 

•  Supplier  test  results 

•  Process  descriptions 

•  Requirements 


2.  Assign  unique  identifiers  to  configuration  items. 

3.  Specify  the  important  characteristics  of  each  configuration  item. 

i  Example  characteristics  of  configuration  items  include  author,  document  or  file  type, 
i  programming  language  for  software  code  files,  and  the  purpose  the  configuration  item 
:  serves. 


4.  Specify  when  each  configuration  item  is  placed  under  configuration 
management. 

:  Example  criteria  for  determining  when  to  place  work  products  under  configuration 
:  management  include  the  following: 

i  •  When  the  acquirer  work  product  is  ready  for  review  and  approval 
:  •  Stage  of  the  project  lifecycle 
i  •  Degree  of  control  desired  on  the  work  product 
j  •  Cost  and  schedule  limitations 
j  •  Stakeholder  requirements 

5.  Identify  the  owner  responsible  for  each  configuration  item. 

6.  Specify  relationships  among  configuration  items. 

Incorporating  the  types  of  relationships  (e.g.,  parent-child,  dependency)  that  exist 
among  configuration  items  into  the  configuration  management  structure  (e.g., 
configuration  management  database)  assists  in  managing  the  effects  and  impacts  of 
changes. 

SP  1.2  Establish  a  Configuration  Management  System 

Establish  and  maintain  a  configuration  management  and  change 
management  system  for  controlling  work  products. 

A  configuration  management  system  includes  the  storage  media, 
procedures,  and  tools  for  accessing  the  system.  A  configuration 
management  system  can  consist  of  multiple  subsystems  with  different 
implementations  that  are  appropriate  for  each  configuration  management 
environment. 

A  change  management  system  includes  the  storage  media,  procedures, 
and  tools  for  recording  and  accessing  change  requests. 

The  acquirer  considers  how  configuration  items  are  shared  between  the 
acquirer  and  supplier  as  well  as  among  relevant  stakeholders.  If  the  use  of 
an  acquirer’s  configuration  management  system  is  extended  to  a  supplier, 
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the  acquirer  should  exercise  security  and  access  control  procedures.  In 
many  cases,  leaving  acquired  configuration  items  in  the  physical 
possession  of  the  supplier  and  having  access  to  supplier  deliverables  is  an 
alternative  solution.  The  supplier  agreement  specifies  appropriate  acquirer 
rights  to  supplier  deliverables,  in  addition  to  requirements  for  delivery  or 
access.  Supplier  work  products,  whenever  they  are  delivered  to  the 
acquirer,  are  presented  in  accordance  with  accepted  standards  to  ensure 
usability  by  the  acquirer. 

Example  Work  Products 

1 .  Configuration  management  system  with  controlled  work  products 

2.  Configuration  management  system  access  control  procedures 

3.  Change  request  database 

Subpractices 

1 .  Establish  a  mechanism  to  manage  multiple  levels  of  control. 

The  level  of  control  is  typically  selected  based  on  project  objectives,  risk,  and 
resources.  Control  levels  can  vary  in  relation  to  the  project  lifecycle,  type  of  system 
under  development,  and  specific  project  requirements. 

i - - 

j  Example  levels  of  control  include  the  following: 
j  •  Uncontrolled:  Anyone  can  make  changes. 

:  •  Work-in-progress:  Authors  control  changes. 

i  •  Released:  A  designated  authority  authorizes  and  controls  changes  and  relevant 
i  stakeholders  are  notified  when  changes  are  made. 


Levels  of  control  can  range  from  informal  control  that  simply  tracks  changes  made 
when  configuration  items  are  being  developed  by  the  acquirer  or  when  supplier  work 
products  are  delivered  or  made  accessible  to  the  acquirer,  to  formal  configuration 
control  using  baselines  that  can  only  be  changed  as  part  of  a  formal  configuration 
management  process. 

2.  Provide  access  control  to  ensure  authorized  access  to  the 
configuration  management  system. 

3.  Store  and  retrieve  configuration  items  in  a  configuration  management 
system. 

4.  Share  and  transfer  configuration  items  between  control  levels  in  the 
configuration  management  system. 

5.  Store  and  recover  archived  versions  of  configuration  items. 

6.  Store,  update,  and  retrieve  configuration  management  records. 

7.  Create  configuration  management  reports  from  the  configuration 
management  system. 

8.  Preserve  the  contents  of  the  configuration  management  system. 
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Examples  of  preservation  functions  of  the  configuration  management  system  include 
the  following: 

•  Backup  and  restoration  of  configuration  management  files 

•  Archive  of  configuration  management  files 

•  Recovery  from  configuration  management  errors 


9.  Revise  the  configuration  management  structure  as  necessary. 

SP  1.3  Create  or  Release  Baselines 

Create  or  release  baselines  for  internal  use  and  for  delivery  to  the 
customer. 

A  baseline  is  represented  by  the  assignment  of  an  identifier  to  a 
configuration  item  or  a  collection  of  configuration  items  and  associated 
entities  at  a  distinct  point  in  time.  As  a  product  or  service  evolves,  multiple 
baselines  can  be  used  to  control  development  and  testing.  (See  the 
definition  of  “baseline”  in  the  glossary.) 

Hardware  products  as  well  as  software  and  documentation  should  also  be 
included  in  baselines  for  infrastructure  related  configurations  (e.g.,  software, 
hardware)  and  in  preparation  for  system  tests  that  include  interfacing 
hardware  and  software. 

The  acquirer  reviews  and  approves  the  release  of  product  baselines 
created  by  the  supplier.  The  acquirer  creates  baselines  for  acquirer  work 
products  that  describe  the  project,  requirements,  funding,  schedule,  and 
project  performance  measures  and  makes  a  commitment  to  manage  the 
project  to  those  baselines. 

Example  Work  Products 

1.  Baselines 

2.  Description  of  baselines 

Example  Supplier  Deliverables 

1.  Product  baselines 

2.  Description  of  product  baselines 

Subpractices 

1 .  Obtain  authorization  from  the  CCB  before  creating  or  releasing 
baselines  of  configuration  items. 

2.  Create  or  release  baselines  only  from  configuration  items  in  the 
configuration  management  system. 

3.  Document  the  set  of  configuration  items  that  are  contained  in  a 
baseline. 

4.  Make  the  current  set  of  baselines  readily  available. 
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SG  2  Track  and  Control  Changes 

Changes  to  the  work  products  under  configuration  management  are  tracked 
and  controlled. 

The  specific  practices  under  this  specific  goal  serve  to  maintain  baselines 
after  they  are  established  by  specific  practices  under  the  Establish 
Baselines  specific  goal. 

SP  2.1  Track  Change  Requests 

Track  change  requests  for  configuration  items. 

Change  requests  address  not  only  new  or  changed  requirements  but  also 
failures  and  defects  in  work  products. 

Change  requests  can  be  initiated  either  by  the  acquirer  or  supplier. 

Changes  that  affect  acquirer  work  products  and  supplier  deliverables  as 
defined  in  the  supplier  agreement  are  handled  through  the  acquirer’s 
configuration  management  process. 

Change  requests  are  analyzed  to  determine  the  impact  that  the  change  will 
have  on  the  work  product,  related  work  products,  the  budget,  and  the 
schedule. 

Example  Work  Products 

1 .  Change  requests 

Example  Supplier  Deliverables 

1 .  Change  requests 

Subpractices 

1 .  Initiate  and  record  change  requests  in  the  change  request  database. 

2.  Analyze  the  impact  of  changes  and  fixes  proposed  in  change  requests. 

Changes  are  evaluated  through  activities  that  ensure  that  they  are  consistent  with  all 
technical  and  project  requirements. 

Changes  are  evaluated  for  their  impact  beyond  immediate  project  or  contract 
requirements.  Changes  to  an  item  used  in  multiple  products  can  resolve  an  immediate 
issue  while  causing  a  problem  in  other  applications. 

The  acquirer  analyzes  the  impact  that  submitted  change  requests  can  have  on 
supplier  agreements. 

Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  the  supplier  agreement. 

Changes  are  evaluated  for  their  impact  on  release  plans. 

3.  Categorize  and  prioritize  change  requests. 

Emergency  requests  are  identified  and  referred  to  an  emergency  authority  if 
appropriate. 

Changes  are  allocated  to  future  baselines. 
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4.  Review  change  requests  to  be  addressed  in  the  next  baseline  with 
relevant  stakeholders  and  get  their  agreement. 

Conduct  the  change  request  review  with  appropriate  participants.  Record  the 
disposition  of  each  change  request  and  the  rationale  for  the  decision,  including 
success  criteria,  a  brief  action  plan  if  appropriate,  and  needs  met  or  unmet  by  the 
change.  Perform  the  actions  required  in  the  disposition  and  report  results  to  relevant 
stakeholders. 

5.  Track  the  status  of  change  requests  to  closure. 

Change  requests  brought  into  the  system  should  be  handled  in  an  efficient  and  timely 
manner.  Once  a  change  request  has  been  processed,  it  is  critical  to  close  the  request 
with  the  appropriate  approved  action  as  soon  as  it  is  practical.  Actions  left  open  result 
in  larger  than  necessary  status  lists,  which  in  turn  result  in  added  costs  and  confusion. 

SP  2.2  Control  Configuration  Items 

Control  changes  to  configuration  items. 

Control  is  maintained  over  the  configuration  of  the  work  product  baseline. 
This  control  includes  tracking  the  configuration  of  each  configuration  item, 
approving  a  new  configuration  if  necessary,  and  updating  the  baseline. 

The  acquirer  decides  which  configuration  items  require  version  control,  or 
more  stringent  levels  of  configuration  control,  and  establishes  mechanisms 
to  ensure  configuration  items  are  controlled.  Although  the  supplier  can 
manage  configuration  items  on  the  acquirer’s  behalf,  the  acquirer  is 
responsible  for  approval  and  control  of  changes  to  these  configuration 
items. 

Example  Work  Products 

1 .  Revision  history  of  configuration  items 

2.  Archives  of  baselines 

Subpractices 

1 .  Control  changes  to  configuration  items  throughout  the  life  of  the 
product  or  service. 

2.  Obtain  appropriate  authorization  before  changed  configuration  items 
are  entered  into  the  configuration  management  system. 

:  For  example,  authorization  can  come  from  the  CCB,  the  project  or  acquisition 
j  manager,  or  the  customer. 

3.  Check  in  and  check  out  configuration  items  in  the  configuration 
management  system  for  incorporation  of  changes  in  a  manner  that 
maintains  the  correctness  and  integrity  of  configuration  items. 
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Examples  of  check-in  and  check-out  steps  include  the  following: 

•  Confirming  that  the  revisions  are  authorized 

•  Updating  the  configuration  items 

•  Archiving  the  replaced  baseline  and  retrieving  the  new  baseline 

•  Commenting  on  the  changes  made  to  the  item 

•  Tying  changes  to  related  work  products  such  as  requirements  and  acceptance 
criteria 


4.  Perform  reviews  to  ensure  that  changes  have  not  caused  unintended 
effects  on  the  baselines  (e.g.,  ensure  that  changes  have  not 
compromised  the  safety  or  security  of  the  system). 

5.  Record  changes  to  configuration  items  and  reasons  for  changes  as 
appropriate. 

If  a  proposed  change  to  the  work  product  is  accepted,  a  schedule  is  identified  for 
incorporating  the  change  into  the  work  product  and  other  affected  areas. 

Configuration  control  mechanisms  can  be  tailored  to  categories  of  changes.  For 
example,  the  approval  considerations  could  be  less  stringent  for  component  changes 
that  do  not  affect  other  components. 

Changed  configuration  items  are  released  after  review  and  approval  of  configuration 
changes.  Changes  are  not  official  until  they  are  released. 

SG  3 _ Establish  Integrity _ 

Integrity  of  baselines  is  established  and  maintained. 

The  integrity  of  baselines,  established  by  processes  associated  with  the 
Establish  Baselines  specific  goal,  and  maintained  by  processes  associated 
with  the  Track  and  Control  Changes  specific  goal,  is  addressed  by  the 
specific  practices  under  this  specific  goal. 

SP  3.1  Establish  Configuration  Management  Records 

Establish  and  maintain  records  describing  configuration  items. 


Example  Work  Products 

1 .  Revision  history  of  configuration  items 

2.  Change  log 

3.  Change  request  records 

4.  Status  of  configuration  items 

5.  Differences  between  baselines 

Example  Supplier  Deliverables 

1 .  Revision  history  of  product  and  supplier  deliverables  defined  in  the 
supplier  agreement 
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Subpractices 

1 .  Record  configuration  management  actions  in  sufficient  detail  so  the 
content  and  status  of  each  configuration  item  is  known  and  previous 
versions  can  be  recovered. 

2.  Ensure  that  relevant  stakeholders  have  access  to  and  knowledge  of 
the  configuration  status  of  configuration  items. 

:  Examples  of  activities  for  communicating  configuration  status  include  the  following: 

:  •  Providing  access  permissions  to  authorized  end  users 
:  •  Making  baseline  copies  readily  available  to  authorized  end  users 

:  •  Automatically  alerting  relevant  stakeholders  when  items  are  checked  in  or  out  or 
changed,  or  of  decisions  made  regarding  change  requests 

3.  Specify  the  latest  version  of  baselines. 

4.  Identify  the  version  of  configuration  items  that  constitute  a  particular 
baseline. 

5.  Describe  differences  between  successive  baselines. 

6.  Revise  the  status  and  history  (i.e.,  changes,  other  actions)  of  each 
configuration  item  as  necessary. 

SP  3.2  Perform  Configuration  Audits 

Perform  configuration  audits  to  maintain  the  integrity  of 
configuration  baselines. 

Configuration  audits  confirm  that  the  resulting  baselines  and  documentation 
conform  to  a  specified  standard  or  requirement.  Configuration  item  related 
records  can  exist  in  multiple  databases  or  configuration  management 
systems.  In  such  instances,  configuration  audits  should  extend  to  these 
other  databases  as  appropriate  to  ensure  accuracy,  consistency,  and 
completeness  of  configuration  item  information.  (See  the  definition  of 
“configuration  audit”  in  the  glossary.) 

i - 

j  Examples  of  audit  types  include  the  following: 

|  •  Functional  configuration  audits  (FCAs):  Audits  conducted  to  verify  that  the  development 
i  of  a  configuration  item  has  been  completed  satisfactorily,  that  the  item  has  achieved  the 

i  functional  and  quality  attribute  characteristics  specified  in  the  functional  or  allocated 

:  baseline,  and  that  its  operational  and  support  documents  are  complete  and  satisfactory, 

i  •  Physical  configuration  audits  (PCAs):  Audits  conducted  to  verify  that  a  configuration 
i  item,  as  built,  conforms  to  the  technical  documentation  that  defines  and  describes  it. 

;  •  Configuration  management  audits:  Audits  conducted  to  confirm  that  configuration 
i  management  records  and  configuration  items  are  complete,  consistent,  and  accurate. 


Example  Work  Products 

1 .  Configuration  audit  results 

2.  Action  items 
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Example  Supplier  Deliverables 

1 .  Supplier  configuration  audit  results 

Subpractices 

1 .  Assess  the  integrity  of  baselines. 

2.  Confirm  that  configuration  management  records  correctly  identify 
configuration  items. 

3.  Review  the  structure  and  integrity  of  items  in  the  configuration 
management  system. 

4.  Confirm  the  completeness,  correctness,  and  consistency  of  items  in 
the  configuration  management  system. 

Completeness,  correctness,  and  consistency  of  the  configuration  management 
system’s  content  are  based  on  requirements  as  stated  in  the  plan  and  the  disposition 
of  approved  change  requests. 

5.  Confirm  compliance  with  applicable  configuration  management 
standards  and  procedures. 

6.  Track  action  items  from  the  audit  to  closure. 
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DECISION  ANALYSIS  AND  RESOLUTION 

A  Support  Process  Area  at  Maturity  Level  3 


Purpose 


The  purpose  of  Decision  Analysis  and  Resolution  (DAR)  is  to  analyze 
possible  decisions  using  a  formal  evaluation  process  that  evaluates 
identified  alternatives  against  established  criteria. 


Introductory  Notes 


The  Decision  Analysis  and  Resolution  process  area  involves  establishing 
guidelines  to  determine  which  issues  should  be  subject  to  a  formal 
evaluation  process  and  applying  formal  evaluation  processes  to  these 
issues. 

A  formal  evaluation  process  is  a  structured  approach  to  evaluating 
alternative  solutions  against  established  criteria  to  determine  a 
recommended  solution. 

A  formal  evaluation  process  involves  the  following  actions: 

•  Establishing  the  criteria  for  evaluating  alternatives 

•  Identifying  alternative  solutions 

•  Selecting  methods  for  evaluating  alternatives 

•  Evaluating  alternative  solutions  using  established  criteria  and  methods 

•  Selecting  recommended  solutions  from  alternatives  based  on 
evaluation  criteria 

Rather  than  using  the  phrase  “alternative  solutions  to  address  issues”  each 
time,  in  this  process  area,  one  of  two  shorter  phrases  are  used:  “alternative 
solutions”  or  “alternatives.” 

A  repeatable  criteria  based  decision-making  process  is  especially 
important,  both  for  making  critical  decisions  that  define  and  guide  the 
acquisition  process  and  later  for  critical  decisions  made  with  the  selected 
supplier.  The  establishment  of  a  formal  process  for  decision  making 
provides  the  acquirer  with  documentation  of  decision  rationale.  Such 
documentation  allows  criteria  for  critical  decisions  to  be  revisited  when 
changes  or  technology  insertion  decisions  that  affect  requirements  or  other 
critical  project  parameters  are  considered  A  formal  process  also  supports 
the  communication  of  decisions  between  the  acquirer  and  supplier. 

A  formal  evaluation  process  reduces  the  subjective  nature  of  a  decision  and 
provides  a  higher  probability  of  selecting  a  solution  that  meets  multiple 
demands  of  relevant  stakeholders. 

While  the  primary  application  of  this  process  area  is  to  technical  concerns, 
formal  evaluation  processes  can  be  applied  to  many  nontechnical  issues, 
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particularly  when  a  project  is  being  planned.  Issues  that  have  multiple 
alternative  solutions  and  evaluation  criteria  lend  themselves  to  a  formal 
evaluation  process. 

Guidelines  are  created  for  deciding  when  to  use  formal  evaluation 
processes  to  address  unplanned  issues.  Guidelines  often  suggest  using 
formal  evaluation  processes  when  issues  are  associated  with  medium-to- 
high-impact  risks  or  when  issues  affect  the  ability  to  achieve  project 
objectives. 

Defining  an  issue  well  helps  to  define  the  scope  of  alternatives  to  be 
considered.  The  right  scope  (i.e.,  not  too  broad,  not  too  narrow)  will  aid  in 
making  an  appropriate  decision  for  resolving  the  defined  issue. 

Formal  evaluation  processes  can  vary  in  formality,  type  of  criteria,  and 
methods  employed.  Less  formal  decisions  can  be  analyzed  in  a  few  hours, 
use  few  criteria  (e.g.,  effectiveness,  cost  to  implement),  and  result  in  a  one- 
or  two-page  report.  More  formal  decisions  can  require  separate  plans, 
months  of  effort,  meetings  to  develop  and  approve  criteria,  simulations, 
prototypes,  piloting,  and  extensive  documentation. 

Both  numeric  and  non-numeric  criteria  can  be  used  in  a  formal  evaluation 
process.  Numeric  criteria  use  weights  to  reflect  the  relative  importance  of 
criteria.  Non-numeric  criteria  use  a  subjective  ranking  scale  (e.g.,  high, 
medium,  low).  More  formal  decisions  can  require  a  full  trade  study. 

A  formal  evaluation  process  identifies  and  evaluates  alternative  solutions. 
The  eventual  selection  of  a  solution  can  involve  iterative  activities  of 
identification  and  evaluation.  Portions  of  identified  alternatives  can  be 
combined,  emerging  technologies  can  change  alternatives,  and  the 
business  situation  of  suppliers  can  change  during  the  evaluation  period. 

A  recommended  alternative  is  accompanied  by  documentation  of  selected 
methods,  criteria,  alternatives,  and  rationale  for  the  recommendation.  The 
documentation  is  distributed  to  relevant  stakeholders;  it  provides  a  record  of 
the  formal  evaluation  process  and  rationale,  which  are  useful  to  other 
projects  that  encounter  a  similar  issue. 

While  some  of  the  decisions  made  throughout  the  life  of  the  project  involve 
the  use  of  a  formal  evaluation  process,  others  do  not.  As  mentioned  earlier, 
guidelines  should  be  established  to  determine  which  issues  should  be 
subject  to  a  formal  evaluation  process. 

Related  Process  Areas 


Refer  to  the  Integrated  Project  Management  process  area  for  more 
information  about  establishing  the  project’s  defined  process. 

Refer  to  the  Risk  Management  process  area  for  more  information  about 
identifying  and  analyzing  risks  and  mitigating  risks. 
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Specific  Goal  and  Practice  Summary 

SG  1  Evaluate  Alternatives 

SP  1 .1  Establish  Guidelines  for  Decision  Analysis 

SP  1.2  Establish  Evaluation  Criteria 

SP  1 .3  Identify  Alternative  Solutions 

SP  1 .4  Select  Evaluation  Methods 

SP  1 .5  Evaluate  Alternative  Solutions 

SP1.6  Select  Solutions 


Specific  Practices  by  Goal 


SG  1  Evaluate  Alternatives 

Decisions  are  based  on  an  evaluation  of  alternatives  using  established 
criteria. 

Issues  requiring  a  formal  evaluation  process  can  be  identified  at  any  time. 
The  objective  should  be  to  identify  issues  as  early  as  possible  to  maximize 
the  time  available  to  resolve  them. 

SP  1.1  Establish  Guidelines  for  Decision  Analysis 

Establish  and  maintain  guidelines  to  determine  which  issues  are 
subject  to  a  formal  evaluation  process. 

Not  every  decision  is  significant  enough  to  require  a  formal  evaluation 
process.  The  choice  between  the  trivial  and  the  truly  important  is  unclear 
without  explicit  guidance.  Whether  a  decision  is  significant  or  not  is 
dependent  on  the  project  and  circumstances  and  is  determined  by 
established  guidelines. 

:  Typical  guidelines  for  determining  when  to  require  a  formal  evaluation  process  include  the 
:  following: 

i  •  When  the  decision  will  have  a  significant  adverse  effect  on  cost,  quality,  resources,  or 
|  schedule 

:  •  When  legal  or  supplier  agreement  issues  must  be  resolved 

i  •  When  challenging  or  competing  quality  attribute  requirements  could  significantly  affect 
:  the  success  of  the  acquisition  strategy  or  the  acquirer  project 

j  •  When  a  decision  is  directly  related  to  issues  that  have  medium-to-high-impact  risk 

|  •  When  a  decision  is  related  to  changing  work  products  under  configuration  management 

:  •  When  a  decision  would  cause  schedule  delays  over  a  certain  percentage  or  amount  of 

:  time 

j  •  When  a  decision  affects  the  ability  of  the  project  to  achieve  its  objectives 
j  •  When  the  costs  of  the  formal  evaluation  process  are  reasonable  when  compared  to  the 
i  decision’s  impact 

:  •  When  a  legal  obligation  exists  during  a  solicitation 


Refer  to  the  Risk  Management  process  area  for  more  information  about 
evaluating,  categorizing,  and  prioritizing  risks. 
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Examples  of  activities  for  which  you  may  use  a  formal  evaluation  process  include  the 
following: 

•  Making  decisions  to  trade  off  cost,  schedule,  and  performance  requirements  during  an 
acquisition 

•  Selecting,  terminating,  or  renewing  suppliers 

•  Selecting  training  for  project  staff 

•  Selecting  a  testing  environment  to  be  used  for  product  validation 

•  Determining  the  items  to  be  selected  for  reuse  in  related  projects 

•  Selecting  an  approach  for  ongoing  support  (e.g.,  disaster  recovery,  service  levels) 


Example  Work  Products 

1 .  Guidelines  for  when  to  apply  a  formal  evaluation  process 

Subpractices 

1 .  Establish  guidelines  for  when  to  use  a  formal  evaluation  process. 

2.  Incorporate  the  use  of  guidelines  into  the  defined  process  as 
appropriate. 

Refer  to  the  Integrated  Project  Management  process  area  for  more 
information  about  establishing  the  project’s  defined  process. 

SP  1.2  Establish  Evaluation  Criteria 

Establish  and  maintain  criteria  for  evaluating  alternatives  and  the 
relative  ranking  of  these  criteria. 

Evaluation  criteria  provide  the  basis  for  evaluating  alternative  solutions. 
Criteria  are  ranked  so  that  the  highest  ranked  criteria  exert  the  most 
influence  on  the  evaluation. 

This  process  area  is  referenced  by  many  other  process  areas  in  the  model, 
and  many  contexts  in  which  a  formal  evaluation  process  can  be  used. 
Therefore,  in  some  situations  you  may  find  that  criteria  have  already  been 
defined  as  part  of  another  process.  This  specific  practice  does  not  suggest 
that  a  second  development  of  criteria  be  conducted. 

A  well-defined  statement  of  the  issue  to  be  addressed  and  the  decision  to 
be  made  focuses  the  analysis  to  be  performed.  Such  a  statement  also  aids 
in  defining  evaluation  criteria  that  minimize  the  possibility  that  decisions  will 
be  second  guessed  or  that  the  reason  for  making  the  decision  will  be 
forgotten.  Decisions  based  on  criteria  that  are  explicitly  defined  and 
established  remove  barriers  to  stakeholder  buy-in. 

Example  Work  Products 

1 .  Documented  evaluation  criteria 

2.  Rankings  of  criteria  importance 

Subpractices 

1 .  Define  the  criteria  for  evaluating  alternative  solutions. 
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Criteria  should  be  traceable  to  requirements,  scenarios,  business  case  assumptions, 
business  objectives,  or  other  documented  sources. 

Types  of  criteria  to  consider  include  the  following: 

•  Technology  limitations 

•  Environmental  impact 

•  Risks 

•  Business  value 

•  Impact  on  priorities 

•  Total  ownership  and  lifecycle  costs 


2.  Define  the  range  and  scale  for  ranking  the  evaluation  criteria. 

Scales  of  relative  importance  for  evaluation  criteria  can  be  established  with  non¬ 
numeric  values  or  with  formulas  that  relate  the  evaluation  parameter  to  a  numeric 
weight. 

3.  Rank  the  criteria. 

The  criteria  are  ranked  according  to  the  defined  range  and  scale  to  reflect  the  needs, 
objectives,  and  priorities  of  the  relevant  stakeholders. 

4.  Assess  the  criteria  and  their  relative  importance. 

5.  Evolve  the  evaluation  criteria  to  improve  their  validity. 

6.  Document  the  rationale  for  the  selection  and  rejection  of  evaluation 
criteria. 

Documentation  of  selection  criteria  and  rationale  may  be  needed  to  justify  solutions  or 
for  future  reference  and  use. 

SP  1 .3  Identify  Alternative  Solutions 

Identify  alternative  solutions  to  address  issues. 

A  wider  range  of  alternatives  can  surface  by  soliciting  as  many  stakeholders 
as  practical  for  input.  Input  from  stakeholders  with  diverse  skills  and 
backgrounds  can  help  teams  identify  and  address  assumptions,  constraints, 
and  biases.  Brainstorming  sessions  can  stimulate  innovative  alternatives 
through  rapid  interaction  and  feedback. 

Sufficient  candidate  solutions  may  not  be  furnished  for  analysis.  As  the 
analysis  proceeds,  other  alternatives  should  be  added  to  the  list  of  potential 
candidate  solutions.  The  generation  and  consideration  of  multiple 
alternatives  early  in  a  decision  analysis  and  resolution  process  increases 
the  likelihood  that  an  acceptable  decision  will  be  made  and  that 
consequences  of  the  decision  will  be  understood. 

Example  Work  Products 

1 .  Identified  alternatives 

Example  Supplier  Deliverables 

1 .  Supplier  identified  alternatives,  if  any 
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Subpractices 

1 .  Perform  a  literature  search. 

A  literature  search  can  uncover  what  others  have  done  both  inside  and  outside  the 
organization.  Such  a  search  can  provide  a  deeper  understanding  of  the  problem, 
alternatives  to  consider,  barriers  to  implementation,  existing  trade  studies,  and  lessons 
learned  from  similar  decisions. 

2.  Identify  alternatives  for  consideration  in  addition  to  the  alternatives  that 
may  be  provided  with  the  issue. 

Evaluation  criteria  are  an  effective  starting  point  for  identifying  alternatives.  Evaluation 
criteria  identify  priorities  of  relevant  stakeholders  and  the  importance  of  technical, 
logistical,  or  other  challenges. 

Combining  key  attributes  of  existing  alternatives  can  generate  additional  and 
sometimes  stronger  alternatives. 

Solicit  alternatives  from  relevant  stakeholders.  Brainstorming  sessions,  interviews,  and 
working  groups  can  be  used  effectively  to  uncover  alternatives. 

3.  Document  proposed  alternatives. 

SP1.4  Select  Evaluation  Methods 

Select  evaluation  methods. 

Methods  for  evaluating  alternative  solutions  against  established  criteria  can 
range  from  simulations  to  the  use  of  probabilistic  models  and  decision 
theory.  These  methods  should  be  carefully  selected.  The  level  of  detail  of  a 
method  should  be  commensurate  with  cost,  schedule,  performance,  and 
risk  impacts. 

While  many  problems  may  require  only  one  evaluation  method,  some 
problems  may  require  multiple  methods.  For  example,  simulations  may 
augment  a  trade  study  to  determine  which  design  alternative  best  meets  a 
given  criterion. 

Suppliers  competing  to  develop  a  technical  solution  for  the  acquirer  may  be 
directly  evaluated  in  a  final  competition  that  involves  a  performance  or 
functional  demonstration  of  proposed  solutions. 

Example  Work  Products 

1 .  Selected  evaluation  methods 

Subpractices 

1 .  Select  methods  based  on  the  purpose  for  analyzing  a  decision  and  on 
the  availability  of  the  information  used  to  support  the  method. 
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Typical  evaluation  methods  include  the  following: 

•  Benchmarking  studies 

•  Cost  studies 

•  Business  opportunity  studies 

•  Surveys 

•  Extrapolations  based  on  field  experience  and  prototypes 

•  User  review  and  comment 

•  Judgment  provided  by  an  expert  or  group  of  experts  (e.g.,  Delphi  method) 


2.  Select  evaluation  methods  based  on  their  ability  to  focus  on  the  issues 
at  hand  without  being  overly  influenced  by  side  issues. 

Results  of  simulations  can  be  skewed  by  random  activities  in  the  solution  that  are  not 
directly  related  to  the  issues  at  hand. 

3.  Determine  the  measures  needed  to  support  the  evaluation  method. 
Consider  the  impact  on  cost,  schedule,  performance,  and  risks. 

SP  1.5  Evaluate  Alternative  Solutions 

Evaluate  alternative  solutions  using  established  criteria  and 
methods. 

Evaluating  alternative  solutions  involves  analysis,  discussion,  and  review. 
Iterative  cycles  of  analysis  are  sometimes  necessary.  Supporting  analyses, 
experimentation,  prototyping,  piloting,  or  simulations  may  be  needed  to 
substantiate  scoring  and  conclusions. 

Often,  the  relative  importance  of  criteria  is  imprecise  and  the  total  effect  on 
a  solution  is  not  apparent  until  after  the  analysis  is  performed.  In  cases 
where  the  resulting  scores  differ  by  relatively  small  amounts,  the  best 
selection  among  alternative  solutions  may  not  be  clear.  Challenges  to 
criteria  and  assumptions  should  be  encouraged. 

Example  Work  Products 

1 .  Evaluation  results 

Subpractices 

1 .  Evaluate  proposed  alternative  solutions  using  the  established 
evaluation  criteria  and  selected  methods. 

2.  Evaluate  assumptions  related  to  the  evaluation  criteria  and  the 
evidence  that  supports  the  assumptions. 

3.  Evaluate  whether  uncertainty  in  the  values  for  alternative  solutions 
affects  the  evaluation  and  address  these  uncertainties  as  appropriate. 

For  instance,  if  the  score  varies  between  two  values,  is  the  difference  significant 
enough  to  make  a  difference  in  the  final  solution  set?  Does  the  variation  in  score 
represent  a  high-impact  risk?  To  address  these  concerns,  simulations  may  be  run, 
further  studies  may  be  performed,  or  evaluation  criteria  may  be  modified,  among  other 
things. 
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4.  Perform  simulations,  modeling,  prototypes,  and  pilots  as  necessary  to 
exercise  the  evaluation  criteria,  methods,  and  alternative  solutions. 

Untested  criteria,  their  relative  importance,  and  supporting  data  or  functions  can  cause 
the  validity  of  solutions  to  be  questioned.  Criteria  and  their  relative  priorities  and  scales 
can  be  tested  with  trial  runs  against  a  set  of  alternatives.  These  trial  runs  of  a  select 
set  of  criteria  allow  for  the  evaluation  of  the  cumulative  impact  of  criteria  on  a  solution. 
If  trials  reveal  problems,  different  criteria  or  alternatives  might  be  considered  to  avoid 
biases. 

5.  Consider  new  alternative  solutions,  criteria,  or  methods  if  proposed 
alternatives  do  not  test  well;  repeat  evaluations  until  alternatives  do 
test  well. 

Document  the  rationale  for  the  addition  of  new  alternatives  or  methods  and  changes  to 
criteria,  as  well  as  the  results  of  interim  evaluations.  Determine  the  scores  for  each 
alternative  based  on  criteria  evaluations  and  scoring  methods  previously  determined. 

6.  Document  the  results  of  the  evaluation. 

Document  the  rationale  for  the  addition  of  new  alternatives  or  methods  and  changes  to 
criteria,  as  well  as  the  results  of  interim  evaluations. 

SP1.6  Select  Solutions 

Select  solutions  from  alternatives  based  on  evaluation  criteria. 

Selecting  solutions  involves  weighing  results  from  the  evaluation  of 
alternatives.  Risks  associated  with  the  implementation  of  solutions  should 
be  assessed. 

Example  Work  Products 

1 .  Recommended  solutions  to  address  significant  issues 

Subpractices 

1 .  Assess  the  risks  associated  with  implementing  the  recommended 
solution. 

Refer  to  the  Risk  Management  process  area  for  more  information 
about  identifying  and  analyzing  risks  and  mitigating  risks. 

Decisions  must  often  be  made  with  incomplete  information.  There  can  be  substantial 
risk  associated  with  the  decision  because  of  having  incomplete  information. 

When  decisions  must  be  made  according  to  a  specific  schedule,  time  and  resources 
may  not  be  available  forgathering  complete  information.  Consequently,  risky  decisions 
made  with  incomplete  information  can  require  re-analysis  later.  Identified  risks  should 
be  monitored. 

2.  Document  and  communicate  to  relevant  stakeholders  the  results  and 
rationale  for  the  recommended  solution. 

It  is  important  to  record  both  why  a  solution  is  selected  and  why  another  solution  was 
rejected. 
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INTEGRATED  PROJECT  MANAGEMENT 

A  Project  Management  Process  Area  at  Maturity  Level  3 


Purpose 


The  purpose  of  Integrated  Project  Management  (IPM)  is  to  establish  and 
manage  the  project  and  the  involvement  of  relevant  stakeholders  according 
to  an  integrated  and  defined  process  that  is  tailored  from  the  organization’s 
set  of  standard  processes. 


Introductory  Notes 


Integrated  Project  Management  involves  the  following  activities: 

•  Establishing  the  project’s  defined  process  at  project  startup  by  tailoring 
the  organization’s  set  of  standard  processes 

•  Managing  the  project  using  the  project’s  defined  process 

•  Establishing  the  work  environment  for  the  project  based  on  the 
organization’s  work  environment  standards 

•  Establishing  teams  that  are  tasked  to  accomplish  project  objectives 

•  Using  and  contributing  to  organizational  process  assets 

•  Enabling  relevant  stakeholders’  concerns  to  be  identified,  considered, 
and,  when  appropriate,  addressed  during  the  project 

•  Ensuring  that  relevant  stakeholders  (1 )  perform  their  tasks  in  a 
coordinated  and  timely  manner;  (2)  address  project  requirements, 
plans,  objectives,  problems,  and  risks;  (3)  fulfill  their  commitments;  and 
(4)  identify,  track,  and  resolve  coordination  issues 

The  integrated  and  defined  process  that  is  tailored  from  the  organization’s 
set  of  standard  processes  is  called  the  project’s  defined  process.  (See  the 
definition  of  “project”  in  the  glossary.) 

Managing  the  project’s  effort,  cost,  schedule,  staffing,  risks,  and  other 
factors  is  tied  to  the  tasks  of  the  project’s  defined  process.  The 
implementation  and  management  of  the  project’s  defined  process  are 
typically  described  in  the  project  plan.  Certain  activities  may  be  covered  in 
other  plans  that  affect  the  project,  such  as  the  quality  assurance  plan,  risk 
management  strategy,  and  the  configuration  management  plan. 

Since  the  defined  process  for  each  project  is  tailored  from  the 
organization’s  set  of  standard  processes,  variability  among  projects  is 
typically  reduced  and  projects  can  easily  share  process  assets,  data,  and 
lessons  learned. 
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This  process  area  also  addresses  the  coordination  of  all  activities  associated  with  the  project 
such  as  the  following: 

•  Development  activities  (e.g,,  requirements  development,  design,  verification) 

•  Service  activities  (e.g.,  delivery,  help  desk,  operations,  customer  contact) 

•  Acquisition  activities  (e.g.,  solicitation,  agreement  monitoring,  transition  to  operations) 

•  Support  activities  (e.g.,  configuration  management,  documentation,  marketing,  training) 


The  working  interfaces  and  interactions  among  relevant  stakeholders 
internal  and  external  to  the  project  are  planned  and  managed  to  ensure  the 
quality  and  integrity  of  the  overall  endeavor.  Relevant  stakeholders 
participate  as  appropriate  in  defining  the  project’s  defined  process  and  the 
project  plan.  Reviews  and  exchanges  are  regularly  conducted  with  relevant 
stakeholders  to  ensure  that  coordination  issues  receive  appropriate 
attention  and  everyone  involved  with  the  project  is  appropriately  aware  of 
status,  plans,  and  activities.  (See  the  definition  of  “relevant  stakeholder”  in 
the  glossary.)  In  defining  the  project’s  defined  process,  formal  interfaces  are 
created  as  necessary  to  ensure  that  appropriate  coordination  and 
collaboration  occurs. 

The  acquirer  should  involve  and  integrate  all  relevant  acquisition,  technical, 
support,  and  operational  stakeholders.  Depending  on  the  scope  and  risk  of 
the  project,  coordination  efforts  with  the  supplier  can  be  significant. 

Formal  interfaces  among  relevant  stakeholders  take  the  form  of 
memoranda  of  understanding,  memoranda  of  agreement,  contractual 
commitments,  associated  supplier  agreements,  and  similar  documents, 
depending  on  the  nature  of  the  interfaces  and  involved  stakeholders. 

This  process  area  applies  in  any  organizational  structure,  including  projects 
that  are  structured  as  line  organizations,  matrix  organizations,  or  teams. 

The  terminology  should  be  appropriately  interpreted  for  the  organizational 
structure  in  place. 

Related  Process  Areas 


Refer  to  the  Agreement  Management  process  area  for  more  information 
about  ensuring  that  the  supplier  and  the  acquirer  perform  according  to  the 
terms  of  the  supplier  agreement. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  aligning  measurement  and  analysis  activities  and  providing 
measurement  results. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  and  maintaining  a  usable  set  of 
organizational  process  assets,  work  environment  standards,  and  rules  and 
guidelines  for  teams. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  the  project  against  the  plan. 
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Refer  to  the  Project  Planning  process  area  for  more  information  about 
developing  a  project  plan. 

Specific  Goal  and  Practice  Summary 

SG  1  Use  the  Project's  Defined  Process 

SP  1 .1  Establish  the  Project's  Defined  Process 
SP  1 .2  Use  Organizational  Process  Assets  for  Planning  Project  Activities 
SP  1 .3  Establish  the  Project's  Work  Environment 

SP1.4  Integrate  Plans 

SP  1.5  Manage  the  Project  Using  Integrated  Plans 
SP1.6  Establish  Teams 

SP  1 .7  Contribute  to  Organizational  Process  Assets 

SG  2  Coordinate  and  Collaborate  with  Relevant  Stakeholders 
SP  2.1  Manage  Stakeholder  Involvement 

SP  2.2  Manage  Dependencies 

SP  2.3  Resolve  Coordination  Issues 

Specific  Practices  by  Goal 


SG  1  Use  the  Project’s  Defined  Process 

The  project  is  conducted  using  a  defined  process  tailored  from  the 
organization’s  set  of  standard  processes. 

The  project’s  defined  process  includes  those  processes  from  the 
organization’s  set  of  standard  processes  that  address  all  processes 
necessary  to  acquire,  develop,  maintain,  or  deliver  the  product. 

The  product  related  lifecycle  processes,  such  as  manufacturing  and  support 
processes,  are  developed  concurrently  with  the  product. 

SP  1.1  Establish  the  Project’s  Defined  Process 

Establish  and  maintain  the  project’s  defined  process  from  project 
startup  through  the  life  of  the  project. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets  and 
establishing  the  organization’s  measurement  repository. 

Refer  to  the  Organizational  Process  Focus  process  area  for  more 
information  about  deploying  organizational  process  assets  and  deploying 
standard  processes. 

The  project’s  defined  process  consists  of  defined  processes  that  form  an 
integrated,  coherent  lifecycle  for  the  project. 

The  project’s  defined  process  logically  sequences  acquirer  activities  and 
supplier  deliverables  (as  identified  in  the  supplier  agreement)  to  deliver  a 
product  that  meets  the  requirements.  The  acquirer  may  require  the  supplier 
to  align  selected  processes  with  the  acquirer’s  defined  process. 

The  project’s  defined  process  should  satisfy  the  project’s  contractual 
requirements,  operational  needs,  opportunities,  and  constraints.  It  is 
designed  to  provide  a  best  fit  for  project  needs. 
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A  project’s  defined  process  is  based  on  the  following  factors: 

•  Stakeholder  requirements 

•  Commitments 

•  Organizational  process  needs  and  objectives 

•  The  organization’s  set  of  standard  processes  and  tailoring  guidelines 

•  The  operational  environment 

•  The  business  environment 

Establishing  the  project’s  defined  process  at  project  startup  helps  to  ensure 
that  project  staff  and  relevant  stakeholders  implement  a  set  of  activities 
needed  to  efficiently  establish  an  initial  set  of  requirements  and  plans  for 
the  project.  As  the  project  progresses,  the  description  of  the  project’s 
defined  process  is  elaborated  and  revised  to  better  meet  project 
requirements  and  the  organization’s  process  needs  and  objectives.  Also,  as 
the  organization’s  set  of  standard  processes  changes,  the  project’s  defined 
process  may  need  to  be  revised. 

The  project’s  defined  process  is  driven  by  the  acquisition  strategy.  The 
acquirer’s  defined  process  is  affected,  for  example,  by  whether  the 
acquisition  strategy  is  to  introduce  new  technology  to  the  organization  or  to 
consolidate  acquired  products  or  services  in  use  by  the  acquirer. 

Example  Work  Products 

1 .  The  project’s  defined  process 

Example  Supplier  Deliverables 

1 .  Tailored  supplier  processes  that  interface  with  the  acquirer’s  defined 
process 

Subpractices 

1 .  Select  a  lifecycle  model  from  the  ones  available  in  organizational 
process  assets. 

i  Examples  of  project  characteristics  that  could  affect  the  selection  of  lifecycle  models 
i  include  the  following: 

:  •  Size  or  complexity  of  the  project 
i  •  Acquisition  strategy 

i  •  Experience  and  familiarity  of  staff  with  implementing  the  process 
j  •  Constraints  such  as  cycle  time  and  acceptable  defect  levels 
|  •  Clarity  of  requirements 
:  •  Customer  expectations 

2.  Select  standard  processes  from  the  organization’s  set  of  standard 
processes  that  best  fit  the  needs  of  the  project. 

3.  Tailor  the  organization’s  set  of  standard  processes  and  other 
organizational  process  assets  according  to  tailoring  guidelines  to 
produce  the  project’s  defined  process. 
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Sometimes  the  available  lifecycle  models  and  standard  processes  are  inadequate  to 
meet  project  needs.  In  such  circumstances,  the  project  should  seek  approval  to 
deviate  from  what  is  required  by  the  organization.  Waivers  are  provided  for  this 
purpose. 

Tailoring  can  include  adapting  the  organization’s  common  measures  and  specifying 
additional  measures  to  meet  the  information  needs  of  the  project, 

4.  Use  other  artifacts  from  the  organization’s  process  asset  library  as 
appropriate. 

i  Other  artifacts  can  include  the  following: 

:  •  Lessons  learned  documents 
i  •  Templates 
j  •  Example  documents 
j  •  Estimating  models 

5.  Document  the  project’s  defined  process. 

6.  Conduct  peer  reviews  of  the  project’s  defined  process. 

Refer  to  the  Acquisition  Verification  process  area  for  more  information 
about  performing  peer  reviews. 

7.  Revise  the  project’s  defined  process  as  necessary. 

SP  1.2  Use  Organizational  Process  Assets  for  Planning  Project  Activities 

Use  organizational  process  assets  and  the  measurement 
repository  for  estimating  and  planning  project  activities. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

When  available,  use  results  of  previous  planning  and  execution  activities  as 
predictors  of  the  relative  scope  and  risk  of  the  effort  being  estimated. 

Example  Work  Products 

1.  Project  estimates 

2.  Project  plans 
Subpractices 

1 .  Use  the  tasks  and  work  products  of  the  project’s  defined  process  as  a 
basis  for  estimating  and  planning  project  activities. 

An  understanding  of  the  relationships  among  tasks  and  work  products  of  the  project’s 
defined  process,  and  of  the  roles  to  be  performed  by  relevant  stakeholders,  is  a  basis 
for  developing  a  realistic  plan. 

2.  Use  the  organization’s  measurement  repository  in  estimating  the 
project’s  planning  parameters. 
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This  estimate  typically  includes  the  following: 

•  Appropriate  historical  data  from  this  project  or  similar  projects 

•  Similarities  and  differences  between  the  current  project  and  those  projects  whose 
historical  data  will  be  used 

•  Validated  historical  data 

•  Reasoning,  assumptions,  and  rationale  used  to  select  the  historical  data 


SP  1.3  Establish  the  Project’s  Work  Environment 

Establish  and  maintain  the  project’s  work  environment  based  on 
the  organization’s  work  environment  standards. 

An  appropriate  work  environment  for  a  project  comprises  an  infrastructure 
of  facilities,  tools,  and  equipment  that  people  need  to  perform  their  jobs 
effectively  in  support  of  business  and  project  objectives.  The  work 
environment  and  its  components  are  maintained  at  a  level  of  work 
environment  performance  and  reliability  indicated  by  organizational  work 
environment  standards.  As  required,  the  project’s  work  environment  or 
some  of  its  components  can  be  developed  internally  or  acquired  from 
external  sources. 

The  supplier’s  work  environment  should  be  compatible  with  the  acquirer’s 
work  environment  to  enable  efficient  and  effective  transfer  of  work  products. 

The  work  environment  might  encompass  environments  for  both  verification 
and  validation  or  these  environments  might  be  separate. 

Refer  to  the  Establish  Work  Environment  Standards  specific  practice  in  the 
Organizational  Process  Definition  process  area  for  more  information  about 
work  environment  standards. 

Example  Work  Products 

1 .  Equipment  and  tools  for  the  project 

2.  Installation,  operation,  and  maintenance  manuals  for  the  project  work 
environment 

3.  User  surveys  and  results 

4.  Use,  performance,  and  maintenance  records 

5.  Support  services  for  the  project’s  work  environment 

Subpractices 

1 .  Plan,  design,  and  install  a  work  environment  for  the  project. 

The  critical  aspects  of  the  project  work  environment  are,  like  any  other  product, 
requirements  driven.  Functionality  and  quality  attributes  of  the  work  environment  are 
explored  with  the  same  rigor  as  is  done  for  any  other  product  development  project. 


160 


Integrated  Project  Management  (IPM) 


CMMI  for  Acquisition,  Version  1.3 


:  It  may  be  necessary  to  make  tradeoffs  among  quality  attributes,  costs,  and  risks.  The 
|  following  are  examples  of  each: 

j  •  Quality  attribute  considerations  can  include  timely  communication,  safety,  security, 
and  maintainability. 

i  •  Costs  can  include  capital  outlays,  training,  a  support  structure;  disassembly  and 
:  disposal  of  existing  environments;  and  the  operation  and  maintenance  of  the 

:  environment. 

i_  •  Risks  can  include  workflow  and  project  disruptions. 

r - 

j  Examples  of  equipment  and  tools  include  the  following: 

j  •  Office  software 

:  •  Decision  support  software 

:  •  Project  management  tools 

j  •  Test  and  evaluation  equipment 

:  •  Requirements  management  tools  and  design  tools 

:  •  Configuration  management  tools 


2.  Provide  ongoing  maintenance  and  operational  support  for  the  project’s 
work  environment. 

Maintenance  and  support  of  the  work  environment  can  be  accomplished  either  with 
capabilities  found  inside  the  organization  or  hired  from  outside  the  organization. 

j  Examples  of  maintenance  and  support  approaches  include  the  following: 

:  •  Hiring  people  to  perform  maintenance  and  support 
;  •  Training  people  to  perform  maintenance  and  support 
:  •  Contracting  maintenance  and  support 
i_  •  Developing  expert  users  for  selected  tools 

3.  Maintain  the  qualification  of  components  of  the  project’s  work 
environment. 

Components  include  software,  databases,  hardware,  tools,  test  equipment,  and 
appropriate  documentation.  Qualification  of  software  includes  appropriate 
certifications.  Hardware  and  test  equipment  qualification  includes  calibration  and 
adjustment  records  and  traceability  to  calibration  standards. 

4.  Periodically  review  how  well  the  work  environment  is  meeting  project 
needs  and  supporting  collaboration,  and  take  action  as  appropriate. 

SP1.4  Integrate  Plans 

Integrate  the  project  plan  and  other  plans  that  affect  the  project  to 
describe  the  project’s  defined  process. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets  and,  in 
particular,  establishing  the  organization’s  measurement  repository. 
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Refer  to  the  Organizational  Process  Focus  process  area  for  more 
information  about  establishing  organizational  process  needs  and 
determining  process  improvement  opportunities. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
developing  a  project  plan. 

This  specific  practice  extends  the  specific  practices  for  establishing  and 
maintaining  a  project  plan  to  address  additional  planning  activities  such  as 
incorporating  the  project’s  defined  process,  coordinating  with  relevant 
stakeholders,  using  organizational  process  assets,  incorporating  plans  for 
peer  reviews,  and  establishing  objective  entry  and  exit  criteria  for  tasks. 

The  development  of  the  project  plan  should  account  for  current  and 
projected  needs,  objectives,  and  requirements  of  the  organization, 
customer,  suppliers,  and  end  users  as  appropriate. 

Example  Work  Products 

1.  Integrated  plans 

Example  Supplier  Deliverables 
1.  Supplier  plans 

Subpractices 

1 .  Integrate  other  plans  that  affect  the  project  with  the  project  plan. 

i  Other  plans  that  affect  the  project  plan  can  include  the  following: 
i  •  Quality  assurance  plans 
:  •  Risk  management  strategy 
:  •  Verification  and  validation  plans 
j  •  Transition  to  operations  and  support  plans 
j  •  Configuration  management  plans 
|  •  Documentation  plans 
:  •  Staff  training  plans 

2.  Incorporate  into  the  project  plan  the  definitions  of  measures  and 
measurement  activities  for  managing  the  project. 

i  Examples  of  measures  that  would  be  incorporated  include  the  following: 

:  •  Organization’s  common  set  of  measures 
\  •  Additional  project  specific  measures 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  developing  and  sustaining  a  measurement  capability 
used  to  support  management  information  needs. 

3.  Identify  and  analyze  product  and  project  interface  risks. 

Refer  to  the  Risk  Management  process  area  for  more  information 
about  identifying  and  analyzing  risks. 
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4.  Schedule  tasks  in  a  sequence  that  accounts  for  critical  development 
and  delivery  factors  and  project  risks. 

j  Examples  of  factors  considered  in  scheduling  include  the  following: 
i  •  Size  and  complexity  of  tasks 
i  •  Needs  of  the  customer  and  end  users 
i  •  Availability  of  critical  resources 
:  •  Availability  of  key  staff 

5.  Incorporate  plans  for  performing  peer  reviews  on  work  products  of  the 
project’s  defined  process. 

6.  Incorporate  the  training  needed  to  perform  the  project’s  defined 
process  in  the  project’s  training  plans. 

This  task  typically  includes  negotiating  with  the  organizational  training  group  on  the 
support  they  will  provide. 

7.  Establish  objective  entry  and  exit  criteria  to  authorize  the  initiation  and 
completion  of  tasks  described  in  the  work  breakdown  structure  (WBS). 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
estimating  the  scope  of  the  project. 

8.  Ensure  that  the  project  plan  is  appropriately  compatible  with  the  plans 
of  relevant  stakeholders. 

Typically  the  plan  and  changes  to  the  plan  will  be  reviewed  for  compatibility. 

9.  Identify  how  conflicts  will  be  resolved  that  arise  among  relevant 
stakeholders. 

Refer  to  the  Agreement  Management  process  area  for  more 
information  about  ensuring  that  the  supplier  and  the  acquirer  perform 
their  work  according  to  the  terms  of  the  supplier  agreement. 

SP  1.5  Manage  the  Project  Using  Integrated  Plans 

Manage  the  project  using  the  project  plan,  other  plans  that  affect 
the  project,  and  the  project’s  defined  process. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

Refer  to  the  Organizational  Process  Focus  process  area  for  more 
information  about  establishing  organizational  process  needs,  deploying 
organizational  process  assets,  and  deploying  standard  processes. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  providing  an  understanding  of  the  project’s  progress  so 
that  appropriate  corrective  actions  can  be  taken  when  the  project’s 
performance  deviates  significantly  from  the  plan. 

Refer  to  the  Risk  Management  process  area  for  more  information  about 
identifying  and  analyzing  risks  and  mitigating  risks. 
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Example  Work  Products 

1 .  Work  products  created  by  performing  the  project’s  defined  process 

2.  Collected  measures  (i.e.,  actuals)  and  status  records  or  reports 

3.  Revised  requirements,  plans,  and  commitments 

4.  Integrated  plans 

Example  Supplier  Deliverables 

1 .  Supplier  project  progress  and  performance  reports 

Subpractices 

1 .  Implement  the  project’s  defined  process  using  the  organization’s 
process  asset  library. 

:  This  task  typically  includes  the  following  activities: 

:  •  Incorporating  artifacts  from  the  organization’s  process  asset  library  into  the  project 
:  as  appropriate 

i  •  Using  lessons  learned  from  the  organization’s  process  asset  library  to  manage  the 
j  project 

2.  Monitor  and  control  the  project’s  activities  and  work  products  using  the 
project’s  defined  process,  project  plan,  and  other  plans  that  affect  the 
project. 

:  This  task  typically  includes  the  following  activities: 

:  •  Using  the  defined  entry  and  exit  criteria  to  authorize  the  initiation  and  determine 
i  the  completion  of  tasks 

|  •  Monitoring  activities  that  could  significantly  affect  actual  values  of  the  project’s 
|  planning  parameters 

:  •  Tracking  project  planning  parameters  using  measurable  thresholds  that  will  trigger 
:  investigation  and  appropriate  actions 

:  •  Monitoring  product  and  project  interface  risks 

:  •  Managing  external  and  internal  commitments  based  on  plans  for  tasks  and  work 
:  products  of  the  project’s  defined  process 


An  understanding  of  the  relationships  among  tasks  and  work  products  of  the  project’s 
defined  process  and  of  the  roles  to  be  performed  by  relevant  stakeholders,  along  with 
well-defined  control  mechanisms  (e.g.,  peer  reviews),  achieves  better  visibility  into 
project  performance  and  better  control  of  the  project. 

3.  Obtain  and  analyze  selected  measurements  to  manage  the  project  and 
support  organization  needs. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  obtaining  measurement  data  and  analyzing 
measurement  data. 

4.  Periodically  review  and  align  the  project’s  performance  with  current 
and  anticipated  needs,  objectives,  and  requirements  of  the 
organization,  customer,  and  end  users  as  appropriate. 
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This  review  includes  alignment  with  organizational  process  needs  and  objectives. 

Examples  of  actions  that  achieve  alignment  include  the  following: 

•  Changing  the  schedule  with  appropriate  adjustments  to  other  planning  parameters 
and  project  risks 

•  Changing  requirements  or  commitments  in  response  to  a  change  in  market 
opportunities  or  customer  and  end-user  needs 

•  Terminating  the  project 


5.  Address  causes  of  selected  issues  that  can  affect  project  objectives. 

Issues  that  require  corrective  action  are  determined  and  analyzed  as  in  the  Analyze 
Issues  and  Take  Corrective  Actions  specific  practices  of  the  Project  Monitoring  and 
Control  process  area.  As  appropriate,  the  project  may  periodically  review  issues 
previously  encountered  on  other  projects  or  in  earlier  phases  of  the  project,  and 
conduct  causal  analysis  of  selected  issues  to  determine  how  to  prevent  recurrence  for 
issues  which  can  significantly  affect  project  objectives.  Project  process  changes 
implemented  as  a  result  of  causal  analysis  activities  should  be  evaluated  for 
effectiveness  to  ensure  that  the  process  change  has  prevented  recurrence  and 
improved  performance. 

SP  1.6  Establish  Teams 

Establish  and  maintain  teams. 

The  project  is  managed  using  teams  that  reflect  the  organizational  rules 
and  guidelines  for  team  structuring,  formation,  and  operation.  (See  the 
definition  of  “team”  in  the  glossary.) 

The  project’s  shared  vision  is  established  prior  to  establishing  the  team 
structure,  which  can  be  based  on  the  WBS.  For  small  organizations,  the 
whole  organization  and  relevant  external  stakeholders  can  be  treated  as  a 
team. 

Refer  to  the  Establish  Rules  and  Guidelines  for  Teams  specific  practice  in 
the  Organizational  Process  Definition  process  area  for  more  information 
about  establishing  and  maintaining  organizational  rules  and  guidelines  for 
the  structure,  formation,  and  operation  of  teams. 

One  of  the  best  ways  to  ensure  coordination  and  collaboration  with  relevant 
stakeholders  is  to  include  them  on  the  team.  For  projects  in  a  system  of 
systems  framework,  the  most  important  team  may  be  with  stakeholders 
representing  other  systems. 

Example  Work  Products 

1 .  Documented  shared  vision 

2.  List  of  members  assigned  to  each  team 

3.  Team  charters 

4.  Periodic  team  status  reports 

Subpractices 

1 .  Establish  and  maintain  the  project’s  shared  vision. 
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When  creating  a  shared  vision,  it  is  critical  to  understand  the  interfaces  between  the 
project  and  stakeholders  external  to  the  project.  The  vision  should  be  shared  among 
relevant  stakeholders  to  obtain  their  agreement  and  commitment. 

2.  Establish  and  maintain  the  team  structure. 

The  project  WBS,  cost,  schedule,  project  risks,  resources,  interfaces,  the  project’s 
defined  process,  and  organizational  guidelines  are  evaluated  to  establish  an 
appropriate  team  structure,  including  team  responsibilities,  authorities,  and 
interrelationships. 

3.  Establish  and  maintain  each  team. 

Establishing  and  maintaining  teams  encompasses  choosing  team  leaders  and  team 
members  and  establishing  team  charters  for  each  team.  It  also  involves  providing 
resources  required  to  accomplish  tasks  assigned  to  the  team. 

4.  Periodically  evaluate  the  team  structure  and  composition. 

Teams  should  be  monitored  to  detect  misalignment  of  work  across  different  teams, 
mismanaged  interfaces,  and  mismatches  of  tasks  to  team  members.  Take  corrective 
action  when  team  or  project  performance  does  not  meet  expectations. 

SP  1 .7  Contribute  to  Organizational  Process  Assets 

Contribute  process  related  experiences  to  organizational  process 
assets. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets,  establishing 
the  organization’s  measurement  repository,  and  establishing  the 
organization’s  process  asset  library. 

Refer  to  the  Organizational  Process  Focus  process  area  for  more 
information  about  incorporating  experiences  into  organizational  process 
assets. 

This  specific  practice  addresses  contributing  information  from  processes  in 
the  project’s  defined  process  to  organizational  process  assets. 

Example  Work  Products 

1 .  Proposed  improvements  to  organizational  process  assets 

2.  Actual  process  and  product  measures  collected  from  the  project 

3.  Documentation  (e.g.,  exemplary  process  descriptions,  plans,  training 
modules,  checklists,  lessons  learned) 

4.  Process  artifacts  associated  with  tailoring  and  implementing  the 
organization’s  set  of  standard  processes  on  the  project 

Subpractices 

1 .  Propose  improvements  to  the  organizational  process  assets. 

2.  Store  process  and  product  measures  in  the  organization’s 
measurement  repository. 
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Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  obtaining  measurement  data. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  project  planning  parameters. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
planning  data  management. 

3.  Submit  documentation  for  possible  inclusion  in  the  organization’s 
process  asset  library. 

j  Examples  of  documentation  include  the  following: 
i  •  Exemplary  process  descriptions 
i  •  Training  modules 
i  •  Exemplary  plans 
i  •  Checklists  and  templates 
i_  •  Tool  configurations 

4.  Document  lessons  learned  from  the  project  for  inclusion  in  the 
organization’s  process  asset  library. 

5.  Provide  process  artifacts  associated  with  tailoring  and  implementing 
the  organization’s  set  of  standard  processes  in  support  of  the 
organization’s  process  monitoring  activities. 

Refer  to  the  Monitor  the  Implementation  specific  practice  in  the 
Organizational  Process  Focus  process  area  for  more  information  about 
the  organization’s  activities  to  understand  the  extent  of  deployment  of 
standard  processes  on  new  and  existing  projects. 

SG  2  Coordinate  and  Collaborate  with  Relevant  Stakeholders 

Coordination  and  collaboration  between  the  project  and  relevant  stakeholders 
are  conducted. 


SP  2.1  Manage  Stakeholder  Involvement 

Manage  the  involvement  of  relevant  stakeholders  in  the  project. 

Stakeholder  involvement  is  managed  according  to  the  project’s  integrated 
plan  and  defined  process. 

The  supplier  agreement  provides  the  basis  for  managing  supplier 
involvement  in  the  project.  Supplier  agreements  (e.g.,  interagency  and 
intercompany  agreements,  memoranda  of  understanding,  memoranda  of 
agreement)  that  the  acquirer  makes  with  stakeholder  organizations,  which 
can  be  product  or  service  providers  or  recipients,  provide  the  basis  for  their 
involvement. 

These  agreements  are  particularly  important  when  the  acquirer’s  project 
produces  a  system  that  will  be  integrated  into  a  larger  system  of  systems. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
planning  stakeholder  involvement  and  obtaining  plan  commitment. 
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Example  Work  Products 

1 .  Agendas  and  schedules  for  collaborative  activities 

2.  Recommendations  for  resolving  relevant  stakeholder  issues 

3.  Documented  issues 

Subpractices 

1 .  Coordinate  with  relevant  stakeholders  who  should  participate  in  project 
activities. 

The  relevant  stakeholders  should  already  be  identified  in  the  project  plan. 

2.  Ensure  work  products  that  are  produced  to  satisfy  commitments  meet 
the  requirements  of  the  recipients. 

The  work  products  produced  to  satisfy  commitments  can  be  services. 

3.  Develop  recommendations  and  coordinate  actions  to  resolve 
misunderstandings  and  problems  with  requirements. 

SP  2.2  Manage  Dependencies 

Participate  with  relevant  stakeholders  to  identify,  negotiate,  and 
track  critical  dependencies. 


Example  Work  Products 

1 .  Defects,  issues,  and  action  items  resulting  from  reviews  with  relevant 
stakeholders 

2.  Critical  dependencies 

3.  Commitments  to  address  critical  dependencies 

4.  Status  of  critical  dependencies 

Example  Supplier  Deliverables 

1 .  Status  of  critical  dependencies 

Subpractices 

1 .  Conduct  reviews  with  relevant  stakeholders. 

It  is  particularly  important  that  acquirers  or  owners  of  systems  that  interact  with  the 
project  in  a  system  of  systems  be  involved  in  these  reviews  to  manage  critical 
dependencies  these  types  of  systems  create. 

2.  Identify  each  critical  dependency. 

3.  Establish  need  dates  and  plan  dates  for  each  critical  dependency 
based  on  the  project  schedule. 

4.  Review  and  get  agreement  on  commitments  to  address  each  critical 
dependency  with  those  who  are  responsible  for  providing  or  receiving 
the  work  product. 

5.  Document  critical  dependencies  and  commitments. 
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The  acquirer  documents  supplier  commitments  to  meet  critical  dependencies  in  the 
supplier  agreement.  Supplier  dependencies  and  acquirer  dependencies  are 
documented  in  an  integrated  plan. 

6.  Track  the  critical  dependencies  and  commitments  and  take  corrective 
action  as  appropriate. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  commitments. 

j  Tracking  critical  dependencies  typically  includes  the  following: 

i  •  Evaluating  the  effects  of  late  and  early  completion  for  impacts  on  future  activities 
:  and  milestones 

:  •  Resolving  actual  and  potential  problems  with  responsible  parties  whenever 
:  possible 

i  •  Escalating  to  the  appropriate  party  the  actual  and  potential  problems  not  resolvable 

i  by  the  responsible  individual  or  group 


SP  2.3  Resolve  Coordination  Issues 

Resolve  issues  with  relevant  stakeholders. 

:  Examples  of  coordination  issues  include  the  following: 
i  •  Incomplete  customer  requirements 

j  •  Unresolved  defects 

:  •  Late  critical  dependencies  and  commitments 

i  •  Product  level  problems 

i  •  Unavailable  critical  resources  or  staff 


Example  Work  Products 

1 .  Relevant  stakeholder  coordination  issues 

2.  Status  of  relevant  stakeholder  coordination  issues 

Subpractices 

1 .  Identify  and  document  issues. 

2.  Communicate  issues  to  relevant  stakeholders. 

3.  Resolve  issues  with  relevant  stakeholders. 

4.  Escalate  to  appropriate  managers  the  issues  not  resolvable  with 
relevant  stakeholders. 

5.  Track  issues  to  closure. 

6.  Communicate  with  relevant  stakeholders  on  the  status  and  resolution 
of  issues. 
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MEASUREMENT  AND  ANALYSIS 

A  Support  Process  Area  at  Maturity  Level  2 


Purpose 


The  purpose  of  Measurement  and  Analysis  (MA)  is  to  develop  and  sustain 
a  measurement  capability  used  to  support  management  information  needs. 


Introductory  Notes 


The  Measurement  and  Analysis  process  area  involves  the  following 
activities: 

•  Specifying  objectives  of  measurement  and  analysis  so  that  they  are 
aligned  with  identified  information  needs  and  project,  organizational,  or 
business  objectives 

•  Specifying  measures,  analysis  techniques,  and  mechanisms  for  data 
collection,  data  storage,  reporting,  and  feedback 

•  Implementing  the  analysis  techniques  and  mechanisms  for  data 
collection,  data  reporting,  and  feedback 

•  Providing  objective  results  that  can  be  used  in  making  informed 
decisions  and  taking  appropriate  corrective  action 

The  integration  of  measurement  and  analysis  activities  into  the  processes 
of  the  project  supports  the  following: 

•  Objective  planning  and  estimating 

•  Tracking  actual  progress  and  performance  against  established  plans 
and  objectives 

•  Identifying  and  resolving  process  related  issues 

•  Providing  a  basis  for  incorporating  measurement  into  additional 
processes  in  the  future 

The  staff  required  to  implement  a  measurement  capability  may  or  may  not 
be  employed  in  a  separate  organization-wide  program.  Measurement 
capability  may  be  integrated  into  individual  projects  or  other  organizational 
functions  (e.g.,  quality  assurance). 

The  initial  focus  for  measurement  activities  is  at  the  project  level.  However, 
a  measurement  capability  can  prove  useful  for  addressing  organization- 
and  enterprise-wide  information  needs.  To  support  this  capability, 
measurement  activities  should  support  information  needs  at  multiple  levels, 
including  the  business,  organizational  unit,  and  project  to  minimize  re-work 
as  the  organization  matures. 

Projects  can  store  project  specific  data  and  results  in  a  project  specific 
repository,  but  when  data  are  to  be  used  widely  or  are  to  be  analyzed  in 
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support  of  determining  data  trends  or  benchmarks,  data  may  reside  in  the 
organization’s  measurement  repository. 

Measurement  and  analysis  of  product  components  provided  by  suppliers  is 
essential  for  effective  management  of  the  quality  and  costs  of  the  project.  It 
is  possible,  with  careful  management  of  supplier  agreements,  to  provide 
insight  into  data  that  support  supplier  performance  analysis. 

The  acquirer  specifies  measures  that  enable  it  to  gauge  its  own  progress 
and  output,  supplier  progress  and  output  as  per  contractual  requirements, 
and  the  status  of  the  evolving  products  acquired.  An  acquirer  establishes 
measurement  objectives  for  its  activities  and  work  products  and  supplier 
activities  and  deliverables.  Measurement  objectives  are  derived  from 
information  needs  that  come  from  project,  organizational,  or  business 
objectives.  In  this  process  area,  when  the  term  “objectives”  is  used  without 
the  “measurement”  qualifier,  it  indicates  either  project,  organizational,  or 
business  objectives. 

Measurement  objectives  are  used  to  define  measures  as  well  as  collection, 
analysis,  storage,  and  usage  procedures  for  measures.  These  measures 
are  specified  in  the  project  plan.  Measures  for  the  supplier,  data  collection 
processes  and  timing,  expected  analysis,  and  required  storage  should  be 
specified  in  the  supplier  agreement. 

In  projects  where  multiple  products  are  acquired  to  deliver  a  capability  to 
the  end  user  or  where  there  are  relationships  with  other  projects  to  acquire 
joint  capabilities,  additional  measures  can  be  identified  to  track  and  achieve 
interoperability  for  programmatic,  technical,  and  operational  interfaces. 

Related  Process  Areas 


Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  a  solicitation  package  and 
establishing  the  supplier  agreement. 

Refer  to  the  Configuration  Management  process  area  for  more  information 
about  establishing  and  maintaining  the  integrity  of  work  products  using 
configuration  identification,  configuration  control,  configuration  status 
accounting,  and  configuration  audits. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  the  organization’s  measurement  repository. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  project  planning  parameters. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
establishing  estimates. 

Refer  to  the  Quantitative  Project  Management  process  area  for  more 
information  about  quantitatively  managing  the  project. 

Refer  to  the  Requirements  Management  process  area  for  more  information 
about  maintaining  bidirectional  traceability  of  requirements. 
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Specific  Goal  and  Practice  Summary 

SG  1  Align  Measurement  and  Analysis  Activities 
SP  1.1  Establish  Measurement  Objectives 
SP  1 .2  Specify  Measures 

SP  1 .3  Specify  Data  Collection  and  Storage  Procedures 

SP  1 .4  Specify  Analysis  Procedures 
SG  2  Provide  Measurement  Results 

SP  2.1  Obtain  Measurement  Data 

SP  2.2  Analyze  Measurement  Data 

SP  2.3  Store  Data  and  Results 

SP  2.4  Communicate  Results 

Specific  Practices  by  Goal 


SG  1  Align  Measurement  and  Analysis  Activities 

Measurement  objectives  and  activities  are  aligned  with  identified  information 
needs  and  objectives. 

The  specific  practices  under  this  specific  goal  can  be  addressed 
concurrently  or  in  any  order. 

When  establishing  measurement  objectives,  experts  often  think  ahead 
about  necessary  criteria  for  specifying  measures  and  analysis  procedures. 
They  also  think  concurrently  about  the  constraints  imposed  by  data 
collection  and  storage  procedures. 

Often  it  is  important  to  specify  the  essential  analyses  to  be  conducted 
before  attending  to  details  of  measurement  specification,  data  collection,  or 
storage. 

SP  1.1  Establish  Measurement  Objectives 

Establish  and  maintain  measurement  objectives  derived  from 
identified  information  needs  and  objectives. 

Measurement  objectives  document  the  purposes  for  which  measurement 
and  analysis  are  done  and  specify  the  kinds  of  actions  that  can  be  taken 
based  on  results  of  data  analyses.  Measurement  objectives  can  also 
identify  the  change  in  behavior  desired  as  a  result  of  implementing  a 
measurement  and  analysis  activity. 

Measurement  objectives  focus  on  acquirer  performance,  supplier 
performance,  and  understanding  the  effects  of  their  performance  on 
customer  operational  and  financial  performance.  Measurement  objectives 
for  the  supplier  enable  defining  and  tracking  service  level  expectations 
documented  in  the  supplier  agreement. 

Measurement  objectives  are  derived  from  information  needs  that  are 
needed  to  do  the  following: 

•  Maintain  alignment  to  project  objectives  and  provide  results  that  keep  a 
project  on  track  to  its  successful  conclusion 
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•  Support  the  organization’s  ability  to  establish  an  infrastructure  that 
reinforces  and  grows  acquirer  capabilities,  including  processes,  people, 
and  technologies  as  appropriate 

•  Support  the  enterprise’s  ability  to  monitor  and  manage  its  financial 
results  and  customer  expectations  as  appropriate 

Measurement  objectives  may  be  constrained  by  existing  processes, 
available  resources,  or  other  measurement  considerations.  Judgments  may 
need  to  be  made  about  whether  the  value  of  the  result  is  commensurate 
with  resources  devoted  to  doing  the  work. 

Modifications  to  identified  information  needs  and  objectives  can,  in  turn,  be 
indicated  as  a  consequence  of  the  process  and  results  of  measurement  and 
analysis. 

t - 

|  Sources  of  information  needs  and  objectives  can  include  the  following: 

|  •  Supplier  agreements  and  contractual  requirements  (e.g.,  service  levels) 

:  •  Customer  expectations 

i  •  Project  plans 

:  •  Project  performance  monitoring 

i  •  Interviews  with  managers  and  others  who  have  information  needs 
i  •  Established  management  objectives 
|  •  Strategic  plans 

j  •  Business  plans 

i  •  Formal  requirements  or  contractual  obligations 
:  •  Recurring  or  other  troublesome  management  or  technical  problems 
i  •  Experiences  of  other  projects  or  organizational  entities 

i  •  External  industry  benchmarks 

|  •  Process  improvement  plans 


r - 

|  Example  measurement  objectives  include  the  following: 

|  •  Provide  insight  into  schedule  fluctuations  and  progress 

:  •  Provide  insight  into  actual  size  compared  to  plan 

i  •  Identify  unplanned  growth 

:  •  Evaluate  the  effectiveness  of  defect  detection  throughout  the  product  development 
j  lifecycle 

|  •  Determine  the  cost  of  correcting  defects 
:  •  Provide  insight  into  actual  costs  compared  to  plan 
:  •  Evaluate  supplier  progress  against  the  plan 

:  •  Evaluate  the  effectiveness  of  mitigating  information  system  vulnerabilities 


Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  project  planning  parameters. 
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Refer  to  the  Project  Planning  process  area  for  more  information  about 
establishing  estimates. 

Refer  to  the  Requirements  Management  process  area  for  more  information 
about  maintaining  bidirectional  traceability  of  requirements. 

Example  Work  Products 

1 .  Measurement  objectives 

Subpractices 

1 .  Document  information  needs  and  objectives. 

2.  Prioritize  information  needs  and  objectives. 

It  can  be  neither  possible  nor  desirable  to  subject  all  initially  identified  information 
needs  to  measurement  and  analysis.  Priorities  may  also  need  to  be  set  within  the 
limits  of  available  resources. 

3.  Document,  review,  and  update  measurement  objectives. 

Carefully  consider  the  purposes  and  intended  uses  of  measurement  and  analysis. 

The  measurement  objectives  are  documented,  reviewed  by  management  and  other 
relevant  stakeholders,  and  updated  as  necessary.  Doing  so  enables  traceability  to 
subsequent  measurement  and  analysis  activities,  and  helps  to  ensure  that  analyses 
will  properly  address  identified  information  needs  and  objectives. 

It  is  important  that  users  of  measurement  and  analysis  results  be  involved  in  setting 
measurement  objectives  and  deciding  on  plans  of  action.  It  may  also  be  appropriate  to 
involve  those  who  provide  the  measurement  data. 

4.  Provide  feedback  for  refining  and  clarifying  information  needs  and 
objectives  as  necessary. 

Identified  information  needs  and  objectives  can  be  refined  and  clarified  as  a  result  of 
setting  measurement  objectives.  Initial  descriptions  of  information  needs  may  be 
ambiguous.  Conflicts  can  arise  between  existing  needs  and  objectives.  Precise  targets 
on  an  already  existing  measure  may  be  unrealistic. 

5.  Maintain  traceability  of  measurement  objectives  to  identified 
information  needs  and  objectives. 

There  should  always  be  a  good  answer  to  the  question,  “Why  are  we  measuring  this?” 

Of  course,  measurement  objectives  can  also  change  to  reflect  evolving  information 
needs  and  objectives. 

6.  Review  appropriate  measurement  objectives  with  potential  suppliers 
throughout  the  solicitation,  obtaining  their  feedback  and  commitment. 

Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  preparing  for  solicitation  and  supplier 
agreement  development. 
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SP  1.2  Specify  Measures 

Specify  measures  to  address  measurement  objectives. 

Measurement  objectives  are  refined  into  precise,  quantifiable  measures. 

Measurement  of  project  and  organizational  work  can  typically  be  traced  to 
one  or  more  measurement  information  categories.  These  categories  include 
the  following:  schedule  and  progress,  effort  and  cost,  size  and  stability,  and 
quality. 

Measures  can  be  either  base  or  derived.  Data  for  base  measures  are 
obtained  by  direct  measurement.  Data  for  derived  measures  come  from 
other  data,  typically  by  combining  two  or  more  base  measures. 

Derived  measures  typically  are  expressed  as  ratios,  composite  indices,  or 
other  aggregate  summary  measures.  They  are  often  more  quantitatively 
reliable  and  meaningfully  interpretable  than  the  base  measures  used  to 
generate  them. 

Base  measures  enable  the  creation  of  many  derived  measures  or  indicators 
from  the  same  standard  data  sources.  In  addition,  there  are  direct 
relationships  among  information  needs,  measurement  objectives, 
measurement  categories,  base  measures,  and  derived  measures.  This 
direct  relationship  is  depicted  using  some  common  examples  in  Table 
MA.1 . 
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Table  MA.1:  Example  Measurement  Relationships 


Example  Project, 
Organizational,  or 
Business 
Objectives 

Information 

Need 

Measurement 

Objective 

Measurement 

Information 

Categories 

Example  Base 
Measures 

Example  Derived 
Measures 

Shorten  time  to 
delivery 

Be  first  to  market 
the  product 

What  is  the 
estimated 
delivery  time? 

Provide  insight 
into  schedule 
fluctuations  and 
progress 

Schedule  and 
progress 

Estimated  and 
actual  start  and  end 
dates  by  task 

Estimated  and 
actual  start  and  end 
dates  of  acquisition 
tasks 

Milestone  performance 

Percentage  of  project 
on  time 

Schedule  estimation 
accuracy 

Increase  market 
share  by  reducing 
costs  of  products 

How  accurate 
are  the  size 
and  cost 

Provide  insight 
into  actual  size 
and  costs 

Size  and  effort 

Estimated  and 
actual  effort  and 
size 

Productivity 

and  services 

estimates? 

compared  to  plan 

Effort  and  cost 

Estimated  and 
actual  cost 

Cost  performance 

Cost  variance 

Deliver  specified 
functionality 

Has  scope  or 
project  size 
grown? 

Provide  insight 
into  actual  size 
compared  to  plan, 
identify  unplanned 

Size  and 
stability 

Requirements  count 

Requirements  volatility 

Size  estimation 
accuracy 

growth 

Function  point  count 

Estimated  vs.  actual 
function  points 

Lines  of  code  count 

Amount  of  new, 
modified,  and  reused 
code 

Reduce  defects  in 
products  delivered 
to  the  customer  by 
10%  without 
affecting  cost 

Where  are 
defects  being 
inserted  and 
detected  prior 
to  delivery? 

Evaluate  the 
effectiveness  of 
defect  detection 
throughout  the 
product  lifecycle 

Quality 

Number  of  defects 
inserted  and 
detected  by  lifecycle 
phase 

Product  size 

Defect  containment  by 
lifecycle  phase 

Defect  density 

What  is  the 
cost  of  rework? 

Determine  the 
cost  of  correcting 
defects 

Cost 

Number  of  defects 
inserted  and 
detected  by  lifecycle 
phase 

Effort  hours  to 
correct  defects 

Labor  rates 

Rework  costs 

Reduce  information 

systems 

vulnerabilities 

What  is  the 
magnitude  of 
open  system 
vulnerabilities? 

Evaluate  the 
effectiveness  of 
mitigating  system 
vulnerabilities 

Information 

assurance 

Number  of  system 
vulnerabilities 
identified  and 
number  of  system 
vulnerabilities 
mitigated 

Percentage  of  system 
vulnerabilities 
mitigated 
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As  a  part  of  their  measurement  and  analysis  activities,  projects  can  also 
consider  the  use  of  Earned  Value  Management  (EVM)  for  measures  related 
to  cost  and  schedule  [EIA  2002b].  EVM  is  a  method  for  objectively 
measuring  cost  and  schedule  progress  and  for  predicting  estimated  total 
costs  and  target  completion  dates  based  on  past  and  current  cost  and 
schedule  performance  trends. 

Typical  EVM  data  include  the  planned  cost  of  accomplishing  specific  and 
measurable  tasks,  the  actual  cost  of  completing  tasks,  and  earned  value, 
which  is  the  planned  cost  of  the  work  actually  completed  for  each  task. 
Using  these  base  measures  or  similar  ones,  the  project  can  calculate 
derived  measures  such  as  schedule  and  cost  variance  and  more  complex 
measures.  These  derived  measures  include  schedule  and  cost 
performance  indices.  EVM  derived  measures  can  assist  with  estimating  the 
cost  for  completion  and  additional  resources  that  may  be  required. 

To  manage  projects,  an  acquirer  uses  supplier  data  (i.e. ,  base  measures) 
and  supplier  reported  derived  measures  in  addition  to  measures  of  acquirer 
progress  and  output.  Supplier  measures  required  by  the  acquirer  allow  the 
acquirer  to  comprehensively  address  measurement  objectives  and  to 
comprehensively  determine  the  progress  of  the  project.  In  some  cases, 
these  supplier  measures  will  augment  acquirer  measures  (e.g.,  supplier’s 
schedule  performance  index  and  size  estimation  accuracy). 

In  most  cases,  supplier  measures  are  the  primary  source  of  data,  especially 
with  regard  to  the  development  of  the  acquired  product  or  service.  For 
instance,  measurement  and  analysis  of  the  product  or  product  components 
provided  by  a  supplier  through  technical  performance  measures  is  essential 
for  effective  management.  Technical  performance  measures  are  precisely 
defined  measures  based  on  a  product  requirement,  product  capability,  or 
some  combination  of  requirements  and  capabilities. 

It  is  important  to  use  measures  to  track  high-risk  items  to  closure  and  to 
help  determine  risk  mitigation  and  corrective  actions.  These  supplier 
measures  should  be  defined  in  the  supplier  agreement,  including  a 
supplier’s  measurement  collection  requirements  and  measurement  reports 
to  be  provided  to  the  acquirer. 

Example  Work  Products 

1 .  Specifications  of  base  and  derived  measures 

2.  Acceptance  criteria  for  supplier  measures 

Subpractices 

1 .  Identify  candidate  measures  based  on  documented  measurement 
objectives. 

Measurement  objectives  are  refined  into  measures.  Identified  candidate  measures  are 
categorized  and  specified  by  name  and  unit  of  measure. 

2.  Maintain  traceability  of  measures  to  measurement  objectives. 

Interdependencies  among  candidate  measures  are  identified  to  enable  later  data 
validation  and  candidate  analyses  in  support  of  measurement  objectives. 
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3.  Identify  existing  measures  that  already  address  measurement 
objectives. 

Specifications  for  measures  may  already  exist,  perhaps  established  for  other  purposes 
earlier  or  elsewhere  in  the  organization. 

4.  Specify  operational  definitions  for  measures. 

Operational  definitions  are  stated  in  precise  and  unambiguous  terms.  They  address 
two  important  criteria: 

•  Communication:  What  has  been  measured,  how  was  it  measured,  what  are  the 
units  of  measure,  and  what  has  been  included  or  excluded? 

•  Repeatability:  Can  the  measurement  be  repeated,  given  the  same  definition,  to  get 
the  same  results? 

5.  Prioritize,  review,  and  update  measures. 

Proposed  specifications  of  measures  are  reviewed  for  their  appropriateness  with 
potential  end  users  and  other  relevant  stakeholders.  Priorities  are  set  or  changed,  and 
specifications  of  measures  are  updated  as  necessary. 

6.  Specify  acceptance  criteria  based  on  operational  definitions  for 
measures  that  come  from  suppliers  to  the  acquirer  in  a  way  that 
enables  their  intended  use. 

Measures  may  be  provided  by  the  supplier  as  detailed  measurement  data  or 
measurement  reports.  Measures  that  come  from  suppliers  should  be  associated  with 
the  acquirer’s  acceptance  criteria  for  supplier  measures.  Acceptance  criteria  may  be 
captured  in  measurement  specifications  or  by  checklists. 

Acceptance  criteria  should  be  defined  in  a  way  that  enables  the  intended  use  of 
supplier  measures,  such  as  potential  aggregation  and  analysis.  These  criteria  should 
include  criteria  associated  with  the  collection  and  transfer  mechanisms  and  procedures 
that  are  performed  by  the  supplier.  Consider  all  characteristics  about  supplier 
measures  that  can  affect  their  use,  such  as  differences  in  financial  calendars  used  by 
different  suppliers. 

SP  1.3  Specify  Data  Collection  and  Storage  Procedures 

Specify  how  measurement  data  are  obtained  and  stored. 

Explicit  specification  of  collection  methods  helps  to  ensure  that  the  right 
data  are  collected  properly.  This  specification  can  also  help  further  clarify 
information  needs  and  measurement  objectives. 

Proper  attention  to  storage  and  retrieval  procedures  helps  to  ensure  that 
data  are  available  and  accessible  for  future  use. 

The  supplier  agreement  specifies  the  measurement  data  the  supplier  must 
provide  to  the  acquirer,  in  what  format  they  must  be  provided  to  the 
acquirer,  how  the  measurement  data  will  be  collected  and  stored  by  the 
supplier  (e.g.,  retention  period  of  data),  how  and  how  often  they  will  be 
transferred  to  the  acquirer,  and  who  has  access  to  data.  Some  supplier 
data  may  be  considered  proprietary  by  the  supplier  and  may  need  to  be 
protected  as  such  by  the  acquirer.  Also  consider  that  some  acquirer 
measurement  data  (e.g.,  total  project  cost  data)  may  be  proprietary  and 
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should  not  be  shared  with  suppliers.  An  acquirer  should  plan  for  the 
collection,  storage,  and  access  control  of  sensitive  data. 

The  acquirer  should  ensure  that  appropriate  mechanisms  are  in  place  to 
obtain  measurement  data  from  the  supplier  in  a  consistent  way.  It  is  critical 
for  the  acquirer  to  insist  in  the  supplier  agreement  on  accurate  data 
collection  by  the  supplier  for  the  acquirer’s  measurement  and  analysis. 

Example  Work  Products 

1 .  Data  collection  and  storage  procedures 

2.  Data  collection  tools 

Example  Supplier  Deliverables 

1 .  Recommendations  for  data  collection  and  storage  procedures 

Subpractices 

1 .  Identify  existing  sources  of  data  that  are  generated  from  current  work 
products,  processes,  or  transactions. 

2.  Identify  measures  for  which  data  are  needed  but  are  not  currently 
available. 

3.  Specify  how  to  collect  and  store  the  data  for  each  required  measure. 

Explicit  specifications  are  made  of  what,  how,  where,  and  when  data  will  be  collected 
and  stored  to  ensure  its  validity  and  to  support  later  use  for  analysis  and 
documentation  purposes. 

r - - 

|  Questions  to  be  considered  typically  include  the  following: 

■  •  Have  required  data  collection  requirements  and  applicable  procedures  been 
I  specified  in  supplier  agreement  standards  and  related  documents? 

i  •  Have  the  frequency  of  collection  and  the  points  in  the  process  where 
:  measurements  will  be  made  been  determined? 

:  •  Has  the  timeline  that  is  required  to  move  measurement  results  from  points  of 
:  collection  to  repositories,  other  databases,  or  end  users  been  established? 

i  •  Who  is  responsible  for  obtaining  data? 
i  •  Who  is  responsible  for  data  storage,  retrieval,  and  security? 

I  •  Have  necessary  supporting  tools  been  developed  or  acquired? 

4.  Create  data  collection  mechanisms  and  process  guidance. 

Data  collection  and  storage  mechanisms  are  well  integrated  with  other  normal  work 
processes.  Data  collection  mechanisms  can  include  manual  or  automated  forms  and 
templates.  Clear,  concise  guidance  on  correct  procedures  is  available  to  those  who 
are  responsible  for  doing  the  work.  Training  is  provided  as  needed  to  clarify  processes 
required  for  the  collection  of  complete  and  accurate  data  and  to  minimize  the  burden 
on  those  who  provide  and  record  data. 

Create  mechanisms  to  transfer  data  and  process  guidance  from  the  supplier  to  the 
acquirer  as  appropriate.  Data  collection  from  a  supplier  can  be  integrated  with  periodic 
monitoring  and  review  of  supplier  activities.  Applicable  standard  report  formats  and 
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tools  to  be  used  for  reporting  by  the  supplier  should  be  specified  in  the  supplier 
agreement, 

5.  Support  automatic  collection  of  data  as  appropriate  and  feasible. 

6.  Prioritize,  review,  and  update  data  collection  and  storage  procedures. 

Proposed  procedures  are  reviewed  for  their  appropriateness  and  feasibility  with  those 
who  are  responsible  for  providing,  collecting,  and  storing  data.  They  also  may  have 
useful  insights  about  how  to  improve  existing  processes  or  may  be  able  to  suggest 
other  useful  measures  or  analyses. 

Review  data  collection  and  storage  procedures  with  potential  suppliers  throughout  the 
solicitation.  Update  data  collection  and  storage  procedures,  as  appropriate,  and  obtain 
supplier  commitment  to  collect  and  store  measurement  data  and  reference  procedures 
in  the  supplier  agreement. 

7.  Update  measures  and  measurement  objectives  as  necessary. 

SP  1.4  Specify  Analysis  Procedures 

Specify  how  measurement  data  are  analyzed  and  communicated. 

Specifying  analysis  procedures  in  advance  ensures  that  appropriate 
analyses  will  be  conducted  and  reported  to  address  documented 
measurement  objectives  (and  thereby  the  information  needs  and  objectives 
on  which  they  are  based).  This  approach  also  provides  a  check  that 
necessary  data  will,  in  fact,  be  collected.  Analysis  procedures  should 
account  for  the  quality  (e.g.,  age,  reliability)  of  all  data  that  enter  into  an 
analysis  (whether  from  the  project,  organization’s  measurement  repository, 
or  other  source).  The  quality  of  data  should  be  considered  to  help  select  the 
appropriate  analysis  procedure  and  evaluate  the  results  of  the  analysis. 

The  supplier  agreement  defines  the  required  data  analysis  and  the 
definition  and  examples  of  measures  the  supplier  must  provide  to  the 
acquirer. 

Example  Work  Products 

1 .  Analysis  specifications  and  procedures 

2.  Data  analysis  tools 

Example  Supplier  Deliverables 

1 .  Recommendations  for  analysis  specification  and  procedures 

Subpractices 

1 .  Specify  and  prioritize  the  analyses  to  be  conducted  and  the  reports  to 
be  prepared. 

Early  on,  pay  attention  to  the  analyses  to  be  conducted  and  to  the  manner  in  which 
results  will  be  reported.  These  analyses  and  reports  should  meet  the  following  criteria: 

•  The  analyses  explicitly  address  the  documented  measurement  objectives. 

•  Presentation  of  results  is  clearly  understandable  by  the  audiences  to  whom  the 
results  are  addressed. 

Priorities  may  have  to  be  set  for  available  resources. 


Measurement  and  Analysis  (MA) 


181 


CMMI  for  Acquisition,  Version  1.3 


Establish  and  maintain  a  description  of  the  analysis  approach  for  data  elements,  a 
description  of  reports  that  must  be  provided  by  the  supplier;  and  a  reference  to 
analysis  specifications  and  procedures  in  the  supplier  agreement. 

2.  Select  appropriate  data  analysis  methods  and  tools. 

i  Issues  to  be  considered  typically  include  the  following: 

i  •  Choice  of  visual  display  and  other  presentation  techniques  (e.g.,  pie  charts,  bar 
:  charts,  histograms,  radar  charts,  line  graphs,  scatter  plots,  tables) 

i  •  Choice  of  appropriate  descriptive  statistics  (e.g.,  arithmetic  mean,  median,  mode) 

i  •  Decisions  about  statistical  sampling  criteria  when  it  is  impossible  or  unnecessary  to 
:  examine  every  data  element 

:  •  Decisions  about  how  to  handle  analysis  in  the  presence  of  missing  data  elements 

:  •  Selection  of  appropriate  analysis  tools 

i  Descriptive  statistics  are  typically  used  in  data  analysis  to  do  the  following: 

:  •  Examine  distributions  of  specified  measures  (e.g.,  central  tendency,  extent  of 
:  variation,  data  points  exhibiting  unusual  variation) 

i  •  Examine  interrelationships  among  specified  measures  (e.g.,  comparisons  of 
|  defects  by  phase  of  the  product’s  lifecycle,  comparisons  of  defects  by  product 
■  component) 

:  •  Display  changes  over  time 


Refer  to  the  Select  Measures  and  Analytic  Techniques  specific  practice 
and  Monitor  the  Performance  of  Selected  Subprocesses  specific 
practice  in  the  Quantitative  Project  Management  process  area  for  more 
information  about  the  appropriate  use  of  statistical  techniques  and 
understanding  variation. 

3.  Specify  administrative  procedures  for  analyzing  data  and 
communicating  results. 

Data  collected  from  a  supplier  are  subject  to  validity  checks  that  can  be  achieved  by 

periodic  audits  of  the  supplier’s  execution  of  data  collection  and  analysis  procedures 

for  acquirer  required  measures.  The  acquirer’s  option  to  perform  validity  checks  of 
measurement  data  collected  by  the  supplier  and  the  supplier’s  execution  of  required 
analysis  procedures  must  be  defined  in  the  supplier  agreement. 

i  Issues  to  be  considered  typically  include  the  following: 

i  •  Identifying  the  persons  and  groups  responsible  for  analyzing  the  data  and 
:  presenting  the  results 

j  •  Determining  the  timeline  to  analyze  the  data  and  present  the  results 

i  •  Determining  the  venues  for  communicating  the  results  (e.g.,  progress  reports, 
j  transmittal  memos,  written  reports,  staff  meetings) 


4.  Review  and  update  the  proposed  content  and  format  of  specified 
analyses  and  reports. 

All  of  the  proposed  content  and  format  are  subject  to  review  and  revision,  including 
analytic  methods  and  tools,  administrative  procedures,  and  priorities.  Relevant 
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stakeholders  consulted  should  include  end  users,  sponsors,  data  analysts,  and  data 
providers. 

Review  specified  analyses  and  reports  with  suppliers  and  identify  their  commitment  to 
support  the  analysis,  and  review  recommendations  they  may  provide  related  to  the 
analysis  of  measurement  data. 

5.  Update  measures  and  measurement  objectives  as  necessary. 

Just  as  measurement  needs  drive  data  analysis,  clarification  of  analysis  criteria  can 
affect  measurement.  Specifications  for  some  measures  may  be  refined  further  based 
on  specifications  established  for  data  analysis  procedures.  Other  measures  may  prove 
unnecessary  or  a  need  for  additional  measures  may  be  recognized. 

Specifying  how  measures  will  be  analyzed  and  reported  can  also  suggest  the  need  for 
refining  measurement  objectives  themselves. 

6.  Specify  criteria  for  evaluating  the  utility  of  analysis  results  and  for 
evaluating  the  conduct  of  measurement  and  analysis  activities. 

i  Criteria  for  evaluating  the  utility  of  the  analysis  might  address  the  extent  to  which  the 
:  following  apply: 

i  •  The  results  are  provided  in  a  timely  manner,  understandable,  and  used  for  decision 

j  making. 

j  •  The  work  does  not  cost  more  to  perform  than  is  justified  by  the  benefits  it  provides. 

:  Criteria  for  evaluating  the  conduct  of  the  measurement  and  analysis  might  include  the 
:  extent  to  which  the  following  apply: 

i  •  The  amount  of  missing  data  or  the  number  of  flagged  inconsistencies  is  beyond 
:  specified  thresholds. 

i  •  There  is  selection  bias  in  sampling  (e.g.,  only  satisfied  end  users  are  surveyed  to 
j  evaluate  end-user  satisfaction,  only  unsuccessful  projects  are  evaluated  to 

j  determine  overall  productivity). 

:  •  Measurement  data  are  repeatable  (e.g.,  statistically  reliable). 

:  •  Statistical  assumptions  have  been  satisfied  (e.g.,  about  the  distribution  of  data, 

:  about  appropriate  measurement  scales). 


SG  2  Provide  Measurement  Results 

Measurement  results,  which  address  identified  information  needs  and 
objectives,  are  provided. 

The  primary  reason  for  conducting  measurement  and  analysis  is  to  address 
identified  information  needs  derived  from  project,  organizational,  and 
business  objectives.  Measurement  results  based  on  objective  evidence  can 
help  to  monitor  progress  and  performance,  fulfill  obligations  documented  in 
a  supplier  agreement,  make  informed  management  and  technical  decisions, 
and  enable  corrective  actions  to  be  taken. 
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SP  2.1  Obtain  Measurement  Data 

Obtain  specified  measurement  data. 

The  data  necessary  for  analysis  are  obtained  and  checked  for 
completeness  and  integrity. 

Example  Work  Products 

1 .  Base  and  derived  measurement  data  sets 

2.  Results  of  data  integrity  tests 

Example  Supplier  Deliverables 

1 .  Base  and  derived  supplier  measurement  data  sets 

2.  Results  of  data  integrity  tests  of  supplier  measurement  data 

Subpractices 

1 .  Obtain  data  for  base  measures. 

Data  are  collected  as  necessary  for  previously  used  and  newly  specified  base 
measures.  Existing  data  are  gathered  from  project  records  or  elsewhere  in  the 
organization. 

Data  are  obtained  from  the  supplier  for  base  measures  as  defined  in  the  supplier 
agreement. 

2.  Generate  data  for  derived  measures. 

Values  are  newly  calculated  for  all  derived  measures. 

Derived  measures  are  obtained  from  the  supplier  as  defined  in  the  supplier  agreement. 

3.  Perform  data  integrity  checks  as  close  to  the  source  of  data  as 
possible. 

All  measurements  are  subject  to  error  in  specifying  or  recording  data.  It  is  always 
better  to  identify  these  errors  and  sources  of  missing  data  early  in  the  measurement 
and  analysis  cycle. 

Checks  can  include  scans  for  missing  data,  out-of-bounds  data  values,  and  unusual 
patterns  and  correlation  across  measures.  It  is  particularly  important  to  do  the 
following: 

•  Test  and  correct  for  inconsistency  of  classifications  made  by  human  judgment  (i.e., 
to  determine  how  frequently  people  make  differing  classification  decisions  based 
on  the  same  information,  otherwise  known  as  “inter-coder  reliability”). 

•  Empirically  examine  the  relationships  among  measures  that  are  used  to  calculate 
additional  derived  measures.  Doing  so  can  ensure  that  important  distinctions  are 
not  overlooked  and  that  derived  measures  convey  their  intended  meanings 
(otherwise  known  as  “criterion  validity”). 

Use  acceptance  criteria  to  verify  the  results  of  data  integrity  tests  conducted  by  the 
supplier  and  to  verify  the  integrity  of  supplier  data.  Follow  up  with  suppliers  if  data  are 
not  available  or  data  integrity  checks  indicate  potential  errors  in  data. 
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SP  2.2 


Refer  to  the  Agreement  Management  process  area  for  more 
information  about  ensuring  that  the  supplier  and  the  acquirer  perform 
according  to  the  terms  of  the  supplier  agreement. 

Analyze  Measurement  Data 

Analyze  and  interpret  measurement  data. 

Measurement  data  are  analyzed  as  planned,  additional  analyses  are 
conducted  as  necessary,  results  are  reviewed  with  relevant  stakeholders, 
and  necessary  revisions  for  future  analyses  are  noted. 

Example  Work  Products 

1 .  Analysis  results  and  draft  reports 

Example  Supplier  Deliverables 

1 .  Responses  to  analysis  results  and  draft  reports 

Subpractices 

1 .  Conduct  initial  analyses,  interpret  results,  and  draw  preliminary 
conclusions. 

The  results  of  data  analyses  are  rarely  self  evident.  Criteria  for  interpreting  results  and 
drawing  conclusions  should  be  stated  explicitly. 

Discuss  results  and  preliminary  conclusions  with  suppliers  as  appropriate. 

2.  Conduct  additional  measurement  and  analysis  as  necessary  and 
prepare  results  for  presentation. 

Results  of  planned  analyses  can  suggest  (or  require)  additional,  unanticipated 
analyses.  In  addition,  these  analyses  can  identify  needs  to  refine  existing  measures,  to 
calculate  additional  derived  measures,  or  even  to  collect  data  for  additional  base 
measures  to  properly  complete  the  planned  analysis.  Similarly,  preparing  initial  results 
for  presentation  can  identify  the  need  for  additional,  unanticipated  analyses. 

Coordinate  additional  analyses  with  suppliers  as  appropriate. 

3.  Review  initial  results  with  relevant  stakeholders. 

It  may  be  appropriate  to  review  initial  interpretations  of  results  and  the  way  in  which 
these  results  are  presented  before  disseminating  and  communicating  them  widely. 

Relevant  stakeholders  with  whom  reviews  may  be  conducted  include  intended  end 
users,  sponsors,  data  analysts,  and  data  providers. 

Review  initial  results  related  to  supplier  progress  or  output  with  suppliers  and 
determine  if  revisions  are  appropriate  based  on  their  response. 

4.  Refine  criteria  for  future  analyses. 

Lessons  that  can  improve  future  efforts  are  often  learned  from  conducting  data 
analyses  and  preparing  results.  Similarly,  ways  to  improve  measurement  specifications 
and  data  collection  procedures  can  become  apparent  as  can  ideas  for  refining 
identified  information  needs  and  objectives. 

Update  data  acceptance  criteria  for  supplier  measures  as  appropriate. 
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SP  2.3  Store  Data  and  Results 

Manage  and  store  measurement  data,  measurement  specifications, 
and  analysis  results. 

Storing  measurement  related  information  enables  its  timely  and  cost 
effective  use  as  historical  data  and  results.  The  information  also  is  needed 
to  provide  sufficient  context  for  interpretation  of  data,  measurement  criteria, 
and  analysis  results. 

i  Information  stored  typically  includes  the  following: 
i  •  Data  acceptance  criteria  for  supplier  data 
j  •  Measurement  plans 
:•  Specifications  of  measures 
i  •  Sets  of  data  that  were  collected 
:  •  Analysis  reports  and  presentations 
:  •  Retention  period  for  data  stored 


Stored  information  contains  or  refers  to  other  information  needed  to 
understand  and  interpret  the  measures  and  to  assess  them  for 
reasonableness  and  applicability  (e.g.,  measurement  specifications  used  on 
different  projects  when  comparing  across  projects). 

Typically,  data  sets  for  derived  measures  can  be  recalculated  and  need  not 
be  stored.  However,  it  may  be  appropriate  to  store  summaries  based  on 
derived  measures  (e.g.,  charts,  tables  of  results,  report  text). 

Interim  analysis  results  need  not  be  stored  separately  if  they  can  be 
efficiently  reconstructed. 

Projects  can  choose  to  store  project  specific  data  and  results  in  a  project 
specific  repository.  When  data  are  shared  across  projects,  the  data  can 
reside  in  the  organization’s  measurement  repository. 

Refer  to  the  Configuration  Management  process  area  for  more  information 
about  establishing  a  configuration  management  system. 

Refer  to  the  Establish  the  Organization’s  Measurement  Repository  specific 
practice  in  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  the  organization’s  measurement  repository. 

Example  Work  Products 

1 .  Stored  data  inventory 

Subpractices 

1 .  Review  data  to  ensure  their  completeness,  integrity,  accuracy,  and 
currency. 

2.  Store  data  according  to  data  storage  procedures. 

3.  Make  stored  contents  available  for  use  only  to  appropriate  groups  and 
staff  members. 
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The  acquirer  protects  measurement  data  provided  by  the  supplier  according  to  the 
supplier  agreement.  The  supplier  agreement  might  specify  that  the  acquirer  must 
restrict  access  to  a  supplier’s  measurement  data  to  acquirer  staff  only, 

4.  Prevent  stored  information  from  being  used  inappropriately. 

i  Examples  of  ways  to  prevent  the  inappropriate  use  of  data  and  related  information 
i  include  controlling  access  to  data  and  educating  people  on  the  appropriate  use  of 
:  data. 

i _ 

:  Examples  of  the  inappropriate  use  of  data  include  the  following: 

:  •  Disclosure  of  information  provided  in  confidence 

i  •  Faulty  interpretations  based  on  incomplete,  out-of-context,  or  otherwise  misleading 
i  information 

:  •  Measures  used  to  improperly  evaluate  the  performance  of  people  or  to  rank 
:  projects 

j  •  Impugning  the  integrity  of  individuals 


SP  2.4  Communicate  Results 

Communicate  results  of  measurement  and  analysis  activities  to  all 
relevant  stakeholders. 

The  results  of  the  measurement  and  analysis  process  are  communicated  to 
relevant  stakeholders  in  a  timely  and  usable  fashion  to  support  decision 
making  and  assist  in  taking  corrective  action. 

Relevant  stakeholders  include  intended  end  users,  sponsors,  data  analysts, 
and  data  providers. 

Relevant  stakeholders  also  include  suppliers. 

Example  Work  Products 

1 .  Delivered  reports  and  related  analysis  results 

2.  Contextual  information  or  guidance  to  help  interpret  analysis  results 

Subpractices 

1 .  Keep  relevant  stakeholders  informed  of  measurement  results  in  a 
timely  manner. 

To  the  extent  possible  and  as  part  of  the  normal  way  they  do  business,  users  of 
measurement  results  are  kept  personally  involved  in  setting  objectives  and  deciding  on 
plans  of  action  for  measurement  and  analysis.  Users  are  regularly  kept  informed  of 
progress  and  interim  results. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  conducting  progress  reviews. 

2.  Assist  relevant  stakeholders  in  understanding  results. 

Results  are  communicated  in  a  clear  and  concise  manner  appropriate  to  relevant 
stakeholders.  Results  are  understandable,  easily  interpretable,  and  clearly  tied  to 
identified  information  needs  and  objectives. 
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The  acquirer  establishes  and  maintains  a  standard  format  for  communicating 
measurement  data  to  relevant  stakeholders. 

The  data  analyzed  are  often  not  self  evident  to  practitioners  who  are  not  measurement 
experts.  The  communication  of  results  should  be  clear  about  the  following: 

•  How  and  why  base  and  derived  measures  were  specified 

•  How  data  were  obtained 

•  How  to  interpret  results  based  on  the  data  analysis  methods  used 

•  How  results  address  information  needs 

Examples  of  actions  taken  to  help  others  to  understand  results  include  the  following: 

•  Discussing  the  results  with  relevant  stakeholders 

•  Providing  background  and  explanation  in  a  document 

•  Briefing  users  on  results 

•  Providing  training  on  the  appropriate  use  and  understanding  of  measurement 
results 


188 


Measurement  and  Analysis  (MA) 


CMMI  for  Acquisition,  Version  1.3 


ORGANIZATIONAL  PROCESS  DEFINITION 

A  Process  Management  Process  Area  at  Maturity  Level  3 


Purpose 


The  purpose  of  Organizational  Process  Definition  (OPD)  is  to  establish  and 
maintain  a  usable  set  of  organizational  process  assets,  work  environment 
standards,  and  rules  and  guidelines  for  teams. 


Introductory  Notes 


Organizational  process  assets  enable  consistent  process  execution  across 
the  organization  and  provide  a  basis  for  cumulative,  long-term  benefits  to 
the  organization.  (See  the  definition  of  “organizational  process  assets”  in 
the  glossary.) 

The  organization’s  process  asset  library  supports  organizational  learning 
and  process  improvement  by  allowing  the  sharing  of  best  practices  and 
lessons  learned  across  the  organization.  (See  the  definition  of 
“organizational  process  assets”  in  the  glossary.) 

The  acquirer’s  organizational  process  assets  also  include  acquisition 
guidance  and  practices  established  for  use  across  acquisition  projects  and 
which  refer  to  applicable  statutes  and  regulations. 

The  organization’s  set  of  standard  processes  also  describes  standard 
interactions  with  suppliers.  Supplier  interactions  are  characterized  by  the 
following  typical  items:  deliverables  expected  from  suppliers,  acceptance 
criteria  applicable  to  those  deliverables,  standards  (e.g.,  architecture  and 
technology  standards),  and  standard  milestone  and  progress  reviews. 

The  organization’s  “set  of  standard  processes”  is  tailored  by  projects  to 
create  their  defined  processes.  Other  organizational  process  assets  are 
used  to  support  tailoring  and  implementing  defined  processes.  Work 
environment  standards  are  used  to  guide  the  creation  of  project  work 
environments.  Rules  and  guidelines  for  teams  are  used  to  aid  in  their 
structuring,  formation,  and  operation. 

A  “standard  process”  is  composed  of  other  processes  (i.e.,  subprocesses) 
or  process  elements.  A  “process  element”  is  the  fundamental  (i.e.,  atomic) 
unit  of  process  definition  that  describes  activities  and  tasks  to  consistently 
perform  work.  The  process  architecture  provides  rules  for  connecting  the 
process  elements  of  a  standard  process.  The  organization’s  set  of  standard 
processes  can  include  multiple  process  architectures. 

(See  the  definitions  of  “standard  process,”  “process  architecture,” 
“subprocess,”  and  “process  element”  in  the  glossary.) 
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Organizational  process  assets  can  be  organized  in  many  ways,  depending  on  the 
implementation  of  the  Organizational  Process  Definition  process  area.  Examples  include  the 
following: 

•  Descriptions  of  lifecycle  models  can  be  part  of  the  organization’s  set  of  standard 
processes  or  they  can  be  documented  separately. 

•  The  organization’s  set  of  standard  processes  can  be  stored  in  the  organization’s 
process  asset  library  or  it  can  be  stored  separately. 

•  A  single  repository  can  contain  both  measurements  and  process  related 
documentation,  or  they  can  be  stored  separately. 


Related  Process  Areas 


Refer  to  the  Organizational  Process  Focus  process  area  for  more 
information  about  deploying  organizational  process  assets. 


Specific  Goal  and  Practice  Summary 

SG  1  Establish  Organizational  Process  Assets 
SP1.1  Establish  Standard  Processes 

SP  1 .2  Establish  Lifecycle  Model  Descriptions 

SP  1 .3  Establish  Tailoring  Criteria  and  Guidelines 

SP  1 .4  Establish  the  Organization's  Measurement  Repository 

SP  1 .5  Establish  the  Organization's  Process  Asset  Library 

SP  1 .6  Establish  Work  Environment  Standards 

SP  1 .7  Establish  Rules  and  Guidelines  for  Teams 


Specific  Practices  by  Goal 


SG  1 _ Establish  Organizational  Process  Assets _ 

A  set  of  organizational  process  assets  is  established  and  maintained. 

SP1.1  Establish  Standard  Processes 

Establish  and  maintain  the  organization’s  set  of  standard 
processes. 

Standard  processes  can  be  defined  at  multiple  levels  in  an  enterprise  and 
they  can  be  related  hierarchically.  For  example,  an  enterprise  can  have  a 
set  of  standard  processes  that  is  tailored  by  individual  organizations  (e.g.,  a 
division,  a  site)  in  the  enterprise  to  establish  their  set  of  standard 
processes.  The  set  of  standard  processes  can  also  be  tailored  for  each  of 
the  organization’s  business  areas,  product  lines,  or  standard  services.  Thus 
the  organization’s  set  of  standard  processes  can  refer  to  the  standard 
processes  established  at  the  organization  level  and  standard  processes 
that  may  be  established  at  lower  levels,  although  some  organizations  may 
have  only  one  level  of  standard  processes.  (See  the  definitions  of  “standard 
process”  and  “organization’s  set  of  standard  processes”  in  the  glossary.) 

Multiple  standard  processes  may  be  needed  to  address  the  needs  of 
different  application  domains,  lifecycle  models,  methodologies,  and  tools. 
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The  organization’s  set  of  standard  processes  contains  process  elements 
(e.g.,  a  work  product  size  estimating  element)  that  may  be  interconnected 
according  to  one  or  more  process  architectures  that  describe  relationships 
among  process  elements. 

The  organization’s  set  of  standard  processes  typically  includes  technical, 
management,  administrative,  support,  and  organizational  processes. 

Basing  standard  processes  on  industry  standards  and  widely  accepted 
models,  with  common  terminology  and  lexicon,  enables  seamless 
interactions  between  the  acquirer  and  supplier.  In  a  multi-supplier 
environment,  this  seamless  interaction  is  most  important  for  acquirer 
standard  processes  that  directly  interface  with  supplier  processes.  Also, 
there  can  be  cost  and  coordination  benefits  from  having  suppliers  work 
together  to  develop  or  reconcile  common  support  processes  that  are 
aligned  with  acquirer  processes. 

The  level  of  detail  required  for  standard  processes  depends  on  the  flexibility 
needed  by  an  enterprise,  for  instance,  based  on  differences  in  business 
context,  project  types,  and  application  domains. 

The  organization’s  set  of  standard  processes  should  collectively  cover  all 
processes  needed  by  the  organization  and  projects,  including  those 
processes  addressed  by  the  process  areas  at  maturity  level  2. 

Example  Work  Products 

1 .  Organization’s  set  of  standard  processes 

Subpractices 

1 .  Decompose  each  standard  process  into  constituent  process  elements 
to  the  detail  needed  to  understand  and  describe  the  process. 

Each  process  element  covers  a  closely  related  set  of  activities.  The  descriptions  of 
process  elements  may  be  templates  to  be  filled  in,  fragments  to  be  completed, 
abstractions  to  be  refined,  or  complete  descriptions  to  be  tailored  or  used  unmodified. 
These  elements  are  described  in  such  detail  that  the  process,  when  fully  defined,  can 
be  consistently  performed  by  appropriately  trained  and  skilled  people. 

I  Examples  of  process  elements  include  the  following: 
i  •  Templates  for  supplier  deliverables 

i  •  Common  lexicon  for  directly  interfacing  acquirer  and  supplier  processes 

i  •  Templates  for  standard  supplier  agreements 

:  •  Description  of  methods  for  verifying  supplier  estimates 

:  •  Description  of  standard  acquisition  approaches  related  to  teaming  with  suppliers 

:  •  Description  of  methods  for  prequalifying  suppliers  as  preferred  suppliers 

i  •  Description  of  standard  acceptance  criteria 

j  •  Description  of  standard  decision  making  and  issue  resolution 

j  •  Template  for  conducting  management  reviews 

j  •  Templates  or  task  flows  embedded  in  workflow  tools 

2.  Specify  the  critical  attributes  of  each  process  element. 
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Examples  of  critical  attributes  include  the  following: 

•  Process  roles 

•  Applicable  standards 

•  Applicable  procedures,  methods,  tools,  and  resources 

•  Process  performance  objectives 

•  Entry  criteria 

•  Inputs 

•  Verification  points  (e.g.,  peer  reviews) 

•  Outputs 

•  Interfaces 

•  Exit  criteria 

•  Product  and  process  measures 


3.  Specify  relationships  among  process  elements. 

r - - 

j  Examples  of  relationships  include  the  following: 

■  •  Order  of  the  process  elements 
j  •  Interfaces  among  process  elements 
i  •  Interfaces  with  external  processes 
i  •  Interdependencies  among  process  elements 

The  rules  for  describing  relationships  among  process  elements  are  referred  to  as  the 
“process  architecture.”  The  process  architecture  covers  essential  requirements  and 
guidelines.  Detailed  specifications  of  these  relationships  are  covered  in  descriptions  of 
defined  processes  that  are  tailored  from  the  organization’s  set  of  standard  processes. 

4.  Ensure  that  the  organization’s  set  of  standard  processes  adheres  to 
applicable  policies,  standards,  and  models. 

Adherence  to  applicable  process  standards  and  models  is  typically  demonstrated  by 
developing  a  mapping  from  the  organization’s  set  of  standard  processes  to  relevant 
process  standards  and  models.  This  mapping  is  a  useful  input  to  future  appraisals. 

5.  Ensure  that  the  organization’s  set  of  standard  processes  satisfies 
process  needs  and  objectives  of  the  organization. 

Refer  to  the  Organizational  Process  Focus  process  area  for  more 
information  about  establishing  organizational  process  needs. 

6.  Ensure  that  there  is  appropriate  integration  among  processes  that  are 
included  in  the  organization’s  set  of  standard  processes. 

7.  Document  the  organization’s  set  of  standard  processes. 

8.  Conduct  peer  reviews  on  the  organization’s  set  of  standard  processes. 

The  acquirer’s  review  of  its  standard  processes  can  include  the  participation  of 
suppliers  for  those  processes  and  process  elements  that  define  standard  interactions 
with  suppliers. 
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Refer  to  the  Acquisition  Verification  process  area  for  more  information 
about  performing  peer  reviews. 

9.  Revise  the  organization’s  set  of  standard  processes  as  necessary. 

■  Examples  of  when  the  organization's  set  of  standard  processes  may  need  to  be 
|  revised  include  the  following: 

:  •  When  improvements  to  the  process  are  identified 

i  •  When  causal  analysis  and  resolution  data  indicate  that  a  process  change  is 
i  needed 

:  •  When  process  improvement  proposals  are  selected  for  deployment  across  the 
:  organization 

j  •  When  the  organization’s  process  needs  and  objectives  are  updated 


SP  1.2  Establish  Lifecycle  Model  Descriptions 

Establish  and  maintain  descriptions  of  lifecycle  models  approved 
for  use  in  the  organization. 

Lifecycle  models  can  be  developed  for  a  variety  of  customers  or  in  a  variety 
of  situations,  since  one  lifecycle  model  may  not  be  appropriate  for  all 
situations.  Lifecycle  models  are  often  used  to  define  phases  of  the  project. 
Also,  the  organization  can  define  different  lifecycle  models  for  each  type  of 
product  and  service  it  delivers. 

Lifecycle  models  describe  acquisition  lifecycles,  depending  on  the 
acquisition  strategy  chosen.  The  acquisition  lifecycle  typically  begins  with 
the  pre-award  phase  of  a  supplier  agreement,  continues  through  the 
phases  of  awarding  and  managing  the  supplier  agreement,  and  ends  when 
the  supplier  agreement  period  of  performance  ends,  usually  with  the 
acceptance  and  completion  of  the  warranty  for  the  acquired  product  and  the 
transition  of  the  product  to  the  support  organization. 

Example  Work  Products 

1 .  Descriptions  of  lifecycle  models 

Subpractices 

1 .  Select  lifecycle  models  based  on  the  needs  of  projects  and  the 
organization. 

2.  Document  descriptions  of  lifecycle  models. 

Lifecycle  models  can  be  documented  as  part  of  the  organization’s  standard  process 
descriptions  or  they  can  be  documented  separately. 

3.  Conduct  peer  reviews  on  lifecycle  models. 

The  acquirer’s  review  of  lifecycle  models  should  include  the  participation  of  suppliers 
for  those  processes  and  process  elements  that  define  expectations  and  constraints  for 
suppliers. 

Refer  to  the  Acquisition  Verification  process  area  for  more  information 
about  performing  peer  reviews. 


Organizational  Process  Definition  (OPD) 


193 


CMMI  for  Acquisition,  Version  1.3 


4.  Revise  the  descriptions  of  lifecycle  models  as  necessary. 

SP  1.3  Establish  Tailoring  Criteria  and  Guidelines 

Establish  and  maintain  tailoring  criteria  and  guidelines  for  the 
organization’s  set  of  standard  processes. 

Tailoring  criteria  and  guidelines  describe  the  following: 

•  How  the  organization’s  set  of  standard  processes  and  organizational 
process  assets  are  used  to  create  defined  processes 

•  Requirements  that  must  be  satisfied  by  defined  processes  (e.g.,  the 
subset  of  organizational  process  assets  that  are  essential  for  any 
defined  process) 

•  Options  that  can  be  exercised  and  criteria  for  selecting  among  options 

•  Procedures  that  must  be  followed  in  performing  and  documenting 
process  tailoring 

:  Examples  of  reasons  for  tailoring  include  the  following: 

:  •  Adapting  the  process  for  a  new  supplier 

i  •  Accommodating  supplier  characteristics  such  as  the  number  of  projects  executed  for 
:  the  acquirer  and  the  supplier’s  process  maturity 

i  •  Following  the  acquisition  strategy 

j  •  Elaborating  the  process  description  so  that  the  resulting  defined  process  can  be 
i  performed 

:  •  Customizing  the  process  for  an  application  or  class  of  similar  applications 


Flexibility  in  tailoring  and  defining  processes  is  balanced  with  ensuring 
appropriate  consistency  of  processes  across  the  organization.  Flexibility  is 
needed  to  address  contextual  variables  such  as  the  domain;  the  nature  of 
the  customer;  cost,  schedule,  and  quality  tradeoffs;  the  technical  difficulty  of 
the  work;  and  the  experience  of  the  people  implementing  the  process. 
Consistency  across  the  organization  is  needed  so  that  organizational 
standards,  objectives,  and  strategies  are  appropriately  addressed,  and 
process  data  and  lessons  learned  can  be  shared. 

Tailoring  is  a  critical  activity  that  allows  controlled  changes  to  processes 
due  to  the  specific  needs  of  a  project  or  a  part  of  the  organization. 
Processes  and  process  elements  that  are  directly  related  to  critical 
business  objectives  should  usually  be  defined  as  mandatory,  but  processes 
and  process  elements  that  are  less  critical  or  only  indirectly  affect  business 
objectives  may  allow  for  more  tailoring. 

The  amount  of  tailoring  could  also  depend  on  the  project’s  lifecycle  model, 
the  supplier,  or  the  acquirer-supplier  relationship. 

Tailoring  criteria  and  guidelines  can  allow  for  using  a  standard  process  “as 
is,”  with  no  tailoring. 

Example  Work  Products 

1 .  Tailoring  guidelines  for  the  organization’s  set  of  standard  processes 
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Subpractices 

1 .  Specify  selection  criteria  and  procedures  for  tailoring  the  organization’s 
set  of  standard  processes. 

To  fully  leverage  the  supplier’s  process  capability,  the  acquirer  can  choose  to  minimize 
the  tailoring  of  the  supplier’s  standard  processes.  Depending  on  the  interfaces  of  the 
acquirer’s  processes  with  the  supplier’s  processes,  the  acquirer’s  standard  processes 
can  be  tailored  to  allow  the  supplier  to  execute  its  standard  processes. 

:  Examples  of  criteria  and  procedures  include  the  following: 
i  •  Criteria  for  selecting  an  acquisition  strategy  and  suppliers 

j  •  Criteria  for  selecting  acquirer  processes  based  on  supplier  process  tailoring  such 
I  as  adding  or  combining  testing  cycles 

:  •  Criteria  for  selecting  lifecycle  models  from  the  ones  approved  by  the  organization 

;  •  Criteria  for  selecting  process  elements  from  the  organization’s  set  of  standard 
:  processes 

:  •  Procedures  for  tailoring  selected  lifecycle  models  and  process  elements  to 
:  accommodate  process  characteristics  and  needs 

:  •  Procedures  for  adapting  the  organization’s  common  measures  to  address 
i  information  needs 

I  Examples  of  tailoring  include  the  following: 
i  •  Modifying  a  lifecycle  model 
i  •  Combining  elements  of  different  lifecycle  models 
;  •  Modifying  process  elements 
:  •  Replacing  process  elements 
•  Reordering  process  elements 

2.  Specify  the  standards  used  for  documenting  defined  processes. 

3.  Specify  the  procedures  used  for  submitting  and  obtaining  approval  of 
waivers  from  the  organization’s  set  of  standard  processes. 

4.  Document  tailoring  guidelines  for  the  organization’s  set  of  standard 
processes. 

5.  Conduct  peer  reviews  on  the  tailoring  guidelines. 

Refer  to  the  Acquisition  Verification  process  area  for  more  information 
about  performing  peer  reviews. 

6.  Revise  tailoring  guidelines  as  necessary. 
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SP  1.4  Establish  the  Organization’s  Measurement  Repository 

Establish  and  maintain  the  organization’s  measurement  repository. 

Refer  to  the  Use  Organizational  Process  Assets  for  Planning  Project 
Activities  specific  practice  in  the  Integrated  Project  Management  process 
area  for  more  information  about  the  use  of  the  organization’s  measurement 
repository  in  planning  project  activities. 

The  repository  contains  both  product  and  process  measures  that  are 
related  to  the  organization’s  set  of  standard  processes.  It  also  contains  or 
refers  to  information  needed  to  understand  and  interpret  measures  and  to 
assess  them  for  reasonableness  and  applicability.  For  example,  the 
definitions  of  measures  are  used  to  compare  similar  measures  from 
different  processes. 

Standard  measures  that  must  be  collected  from  the  supplier  are  included  as 
requirements  in  standard  supplier  agreements  and  can  appear  in  the 
organization’s  measurement  repository. 

Example  Work  Products 

1 .  Definition  of  the  common  set  of  product  and  process  measures  for  the 
organization’s  set  of  standard  processes 

2.  Design  of  the  organization’s  measurement  repository 

3.  Organization’s  measurement  repository  (i.e.,  the  repository  structure, 
support  environment) 

4.  Organization’s  measurement  data 

Subpractices 

1 .  Determine  the  organization’s  needs  for  storing,  retrieving,  and 
analyzing  measurements. 

2.  Define  a  common  set  of  process  and  product  measures  for  the 
organization’s  set  of  standard  processes. 

Measures  in  the  common  set  are  selected  for  their  ability  to  provide  visibility  into 
processes  critical  to  achieving  business  objectives  and  to  focus  on  process  elements 
significantly  impacting  cost,  schedule,  and  performance  within  a  project  and  across  the 
organization.  The  common  set  of  measures  can  vary  for  different  standard  processes. 

Measures  defined  include  the  ones  related  to  agreement  management,  some  of  which 
may  need  to  be  collected  from  suppliers. 

Operational  definitions  for  measures  specify  procedures  for  collecting  valid  data  and 
the  point  in  the  process  where  data  will  be  collected. 

3.  Design  and  implement  the  measurement  repository. 

Functions  of  the  measurement  repository  include  the  following: 

•  Supporting  effective  comparison  and  interpretation  of  measurement  data  among 
projects 

•  Providing  sufficient  context  to  allow  a  new  project  to  quickly  identify  and  access 
data  in  the  repository  for  similar  projects 
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•  Enabling  projects  to  improve  the  accuracy  of  their  estimates  by  using  their  own 
and  other  projects’  historical  data 

•  Aiding  in  the  understanding  of  process  performance 

•  Supporting  potential  statistical  management  of  processes  or  subprocesses,  as 
needed 

4.  Specify  procedures  for  storing,  updating,  and  retrieving  measures. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  specifying  data  collection  and  storage  procedures. 

5.  Conduct  peer  reviews  on  definitions  of  the  common  set  of  measures 
and  procedures  for  storing,  updating,  and  retrieving  measures. 

Refer  to  the  Acquisition  Verification  process  area  for  more  information 
about  performing  peer  reviews. 

6.  Enter  specified  measures  into  the  repository. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  specifying  measures. 

7.  Make  the  contents  of  the  measurement  repository  available  for  use  by 
the  organization  and  projects  as  appropriate. 

8.  Revise  the  measurement  repository,  the  common  set  of  measures,  and 
procedures  as  the  organization’s  needs  change. 

:  Examples  of  when  the  common  set  of  measures  may  need  to  be  revised  include  the 
i  following: 

i  •  New  processes  are  added 
i  •  Processes  are  revised  and  new  measures  are  needed 
:  •  Finer  granularity  of  data  is  required 
j  •  Greater  visibility  into  the  process  is  required 
:  •  Measures  are  retired 
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SP  1.5  Establish  the  Organization’s  Process  Asset  Library 

Establish  and  maintain  the  organization’s  process  asset  library. 

:  Examples  of  items  to  be  stored  in  the  organization’s  process  asset  library  include  the 
i  following: 

i  •  Organizational  policies 

j  •  Process  descriptions 

:  •  Procedures  (e.g.,  estimating  procedure) 

i  •  Development  plans 

:  •  Acquisition  plans 

:  •  Quality  assurance  plans 

i  •  Training  materials 

j  •  Process  aids  (e.g.,  checklists) 

I  •  Lessons  learned  reports 


Example  Work  Products 

1 .  Design  of  the  organization’s  process  asset  library 

2.  The  organization’s  process  asset  library 

3.  Selected  items  to  be  included  in  the  organization’s  process  asset 
library 

4.  The  catalog  of  items  in  the  organization’s  process  asset  library 

Subpractices 

1 .  Design  and  implement  the  organization’s  process  asset  library, 
including  the  library  structure  and  support  environment. 

2.  Specify  criteria  for  including  items  in  the  library. 

Items  are  selected  based  primarily  on  their  relationship  to  the  organization’s  set  of 
standard  processes. 

3.  Specify  procedures  for  storing,  updating,  and  retrieving  items. 

4.  Enter  selected  items  into  the  library  and  catalog  them  for  easy 
reference  and  retrieval. 

5.  Make  items  available  for  use  by  projects. 

6.  Periodically  review  the  use  of  each  item. 

7.  Revise  the  organization’s  process  asset  library  as  necessary. 

r - 

|  Examples  of  when  the  library  may  need  to  be  revised  include  the  following: 

|  •  New  items  are  added 
:  •  Items  are  retired 

i  •  Current  versions  of  items  are  changed 
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SP  1.6  Establish  Work  Environment  Standards 

Establish  and  maintain  work  environment  standards. 

Work  environment  standards  allow  the  organization  and  projects  to  benefit 
from  common  tools,  training,  and  maintenance,  as  well  as  cost  savings  from 
volume  purchases.  Work  environment  standards  address  the  needs  of  all 
stakeholders  and  consider  productivity,  cost,  availability,  security,  and 
workplace  health,  safety,  and  ergonomic  factors.  Work  environment 
standards  can  include  guidelines  for  tailoring  and  the  use  of  waivers  that 
allow  adaptation  of  the  project’s  work  environment  to  meet  needs. 

i  Examples  of  work  environment  standards  include  the  following: 

:  •  Procedures  for  the  operation,  safety,  and  security  of  the  work  environment 
i  •  Standard  workstation  hardware  and  software 
i  •  Standard  application  software  and  tailoring  guidelines  for  it 
|  •  Standard  production  and  calibration  equipment 
:  •  Process  for  requesting  and  approving  tailoring  or  waivers 


Example  Work  Products 

1.  Work  environment  standards 

Subpractices 

1 .  Evaluate  commercially  available  work  environment  standards 
appropriate  for  the  organization. 

2.  Adopt  existing  work  environment  standards  and  develop  new  ones  to 
fill  gaps  based  on  the  organization’s  process  needs  and  objectives. 

SP  1.7  Establish  Rules  and  Guidelines  for  Teams 

Establish  and  maintain  organizational  rules  and  guidelines  for  the 
structure,  formation,  and  operation  of  teams. 

In  an  acquisition  organization,  teams  are  useful  not  just  in  the  acquirer’s 
organization  but  between  the  acquirer  and  supplier  and  among  the  acquirer, 
supplier,  and  other  relevant  stakeholders  as  appropriate.  Teams  can  be 
especially  important  in  a  system  of  systems  environment. 

Operating  rules  and  guidelines  for  teams  define  and  control  how  teams  are 
created  and  how  they  interact  to  accomplish  objectives.  Team  members 
should  understand  the  standards  for  work  and  participate  according  to 
those  standards. 

When  establishing  rules  and  guidelines  for  teams,  ensure  they  comply  with 
all  local  and  national  regulations  or  laws  that  can  affect  the  use  of  teams. 

Structuring  teams  involves  defining  the  number  of  teams,  the  type  of  each 
team,  and  how  each  team  relates  to  the  others  in  the  structure.  Forming 
teams  involves  chartering  each  team,  assigning  team  members  and  team 
leaders,  and  providing  resources  to  each  team  to  accomplish  work. 
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Example  Work  Products 

1 .  Rules  and  guidelines  for  structuring  and  forming  teams 

2.  Operating  rules  for  teams 

Subpractices 

1 .  Establish  and  maintain  empowerment  mechanisms  to  enable  timely 
decision  making. 

In  a  successful  teaming  environment,  clear  channels  of  responsibility  and  authority  are 
established  by  documenting  and  deploying  organizational  guidelines  that  clearly  define 
the  empowerment  of  teams. 

2.  Establish  and  maintain  rules  and  guidelines  for  structuring  and  forming 
teams. 

■  Organizational  process  assets  can  help  the  project  to  structure  and  implement  j 
j  teams.  Such  assets  can  include  the  following:  j 

:  •  Guidelines  for  establishing  lines  of  communication,  authority,  and  escalation  ■ 
i  •  Team  structure  guidelines  i 

i  •  Team  formation  guidelines  j 

i  •  Team  authority  and  responsibility  guidelines  : 

:•  Team  leader  selection  criteria  : 

i _ j 

3.  Define  the  expectations,  rules,  and  guidelines  that  guide  how  teams 
work  collectively. 

j  These  rules  and  guidelines  establish  organizational  practices  for  consistency  across 
j  teams  and  can  include  the  following: 

:  •  How  interfaces  among  teams  are  established  and  maintained 
:  •  How  assignments  are  accepted  and  transferred 
i  •  How  resources  and  inputs  are  accessed 
:  •  How  work  gets  done 
i  •  Who  checks,  reviews,  and  approves  work 
j  •  How  work  is  approved 
j  •  How  work  is  delivered  and  communicated 
j  •  Who  reports  to  whom 

:  •  What  the  reporting  requirements  (e.g.,  cost,  schedule,  performance  status), 

:  measures,  and  methods  are 

:  •  Which  progress  reporting  measures  and  methods  are  used 
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ORGANIZATIONAL  PROCESS  FOCUS 

A  Process  Management  Process  Area  at  Maturity  Level  3 


Purpose 


The  purpose  of  Organizational  Process  Focus  (OPF)  is  to  plan,  implement, 
and  deploy  organizational  process  improvements  based  on  a  thorough 
understanding  of  current  strengths  and  weaknesses  of  the  organization’s 
processes  and  process  assets. 


Introductory  Notes 


The  organization’s  processes  include  all  processes  used  by  the 
organization  and  its  projects.  Candidate  improvements  to  the  organization’s 
processes  and  process  assets  are  obtained  from  various  sources,  including 
the  measurement  of  processes,  lessons  learned  in  implementing 
processes,  results  of  process  appraisals,  results  of  product  and  service 
evaluation  activities,  results  of  customer  satisfaction  evaluations,  results  of 
benchmarking  against  other  organizations’  processes,  and 
recommendations  from  other  improvement  initiatives  in  the  organization. 

Process  improvement  occurs  in  the  context  of  the  organization’s  needs  and 
is  used  to  address  the  organization’s  objectives.  The  organization 
encourages  participation  in  process  improvement  activities  by  those  who 
perform  the  process.  The  responsibility  for  facilitating  and  managing  the 
organization’s  process  improvement  activities,  including  coordinating  the 
participation  of  others,  is  typically  assigned  to  a  process  group.  The 
organization  provides  the  long-term  commitment  and  resources  required  to 
sponsor  this  group  and  to  ensure  the  effective  and  timely  deployment  of 
improvements. 

The  acquirer  encourages  supplier  participation  in  process  improvement 
activities. 

Careful  planning  is  required  to  ensure  that  process  improvement  efforts 
across  the  organization  are  adequately  managed  and  implemented.  Results 
of  the  organization’s  process  improvement  planning  are  documented  in  a 
process  improvement  plan. 

The  “organization’s  process  improvement  plan”  addresses  appraisal 
planning,  process  action  planning,  pilot  planning,  and  deployment  planning. 
Appraisal  plans  describe  the  appraisal  timeline  and  schedule,  the  scope  of 
the  appraisal,  resources  required  to  perform  the  appraisal,  the  reference 
model  against  which  the  appraisal  will  be  performed,  and  logistics  for  the 
appraisal. 

Process  action  plans  usually  result  from  appraisals  and  document  how 
improvements  targeting  weaknesses  uncovered  by  an  appraisal  will  be 
implemented.  Sometimes  the  improvement  described  in  the  process  action 
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plan  should  be  tested  on  a  small  group  before  deploying  it  across  the 
organization.  In  these  cases,  a  pilot  plan  is  generated. 

When  the  improvement  is  to  be  deployed,  a  deployment  plan  is  created. 
This  plan  describes  when  and  how  the  improvement  will  be  deployed 
across  the  organization. 

Organizational  process  assets  are  used  to  describe,  implement,  and 
improve  the  organization’s  processes.  (See  the  definition  of  “organizational 
process  assets”  in  the  glossary.) 


Related  Process  Areas 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

Specific  Goal  and  Practice  Summary 

SG  1  Determine  Process  Improvement  Opportunities 

SP  1.1  Establish  Organizational  Process  Needs 
SP  1 .2  Appraise  the  Organization’s  Processes 
SP  1 .3  Identify  the  Organization’s  Process  Improvements 
SG  2  Plan  and  Implement  Process  Actions 

SP  2.1  Establish  Process  Action  Plans 

SP  2.2  Implement  Process  Action  Plans 

SG  3  Deploy  Organizational  Process  Assets  and  Incorporate  Experiences 
SP  3.1  Deploy  Organizational  Process  Assets 

SP  3.2  Deploy  Standard  Processes 

SP  3.3  Monitor  the  Implementation 

SP  3.4  Incorporate  Experiences  into  Organizational  Process  Assets 

Specific  Practices  by  Goal 


SG  1  Determine  Process  Improvement  Opportunities 

Strengths,  weaknesses,  and  improvement  opportunities  for  the  organization’s 
processes  are  identified  periodically  and  as  needed. 

Strengths,  weaknesses,  and  improvement  opportunities  can  be  determined 
relative  to  a  process  standard  or  model  such  as  a  CMMI  model  or  ISO 
standard.  Process  improvements  should  be  selected  to  address  the 
organization’s  needs. 

Process  improvement  opportunities  can  arise  as  a  result  of  changing 
business  objectives,  legal  and  regulatory  requirements,  and  results  of 
benchmarking  studies. 

SP  1.1  Establish  Organizational  Process  Needs 

Establish  and  maintain  the  description  of  process  needs  and 
objectives  for  the  organization. 

The  organization’s  processes  operate  in  a  business  context  that  should  be 
understood.  The  organization’s  business  objectives,  needs,  and  constraints 
determine  the  needs  and  objectives  for  the  organization’s  processes. 
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Typically,  issues  related  to  customer  satisfaction,  finance,  technology, 
quality,  human  resources,  and  marketing  are  important  process 
considerations. 

The  organization’s  process  needs  and  objectives  cover  aspects  that  include  the  following: 

•  Characteristics  of  processes 

•  Process  performance  objectives,  such  as  time-to-market  and  delivered  quality 

•  Process  effectiveness 


Issues  related  to  the  organization’s  acquisition  management  needs  are 
important  process  considerations. 

Example  Work  Products 

1 .  The  organization’s  process  needs  and  objectives 

Subpractices 

1 .  Identify  policies,  standards,  and  business  objectives  that  are  applicable 
to  the  organization’s  processes. 

i  Examples  of  standards  include  the  following: 

:  •  ISO/IEC  12207:2008  Systems  and  Software  Engineering  -  Software  Life  Cycle 
:  Processes  [ISO  2008a] 

|  •  ISO/IEC  15288:2008  Systems  and  Software  Engineering  -  System  Life  Cycle 
j  Processes  [ISO  2008b] 

|  •  ISO/IEC  27001 :2005  Information  technology  -  Security  techniques  -  Information 
i  Security  Management  Systems  -  Requirements  [ISO/IEC  2005] 

i  •  ISO/IEC  14764:2006  Software  Engineering  -  Software  Life  Cycle  Processes  - 
i  Maintenance  [ISO  2006b] 

:  •  ISO/IEC  20000  Information  Technology  -  Service  Management  [ISO  2005b] 

:  •  Assurance  Focus  for  CMMI  [DHS  2009] 

]  •  NDIA  Engineering  for  System  Assurance  Guidebook  [NDIA  2008] 
j  •  Resiliency  Management  Model  [SEI  2010c] 

2.  Examine  relevant  process  standards  and  models  for  best  practices. 

3.  Determine  the  organization’s  process  performance  objectives. 

Process  performance  objectives  can  be  expressed  in  quantitative  or  qualitative  terms. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  establishing  measurement  objectives. 

Refer  to  the  Organizational  Process  Performance  process  area  for 
more  information  about  establishing  quality  and  process  performance 
objectives. 
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Examples  of  process  performance  objectives  include  the  following: 

•  Reduce  defect  insertion  rate  by  a  certain  percentage 

•  Achieve  a  certain  cycle  time  for  a  given  activity 

•  Improve  productivity  by  a  given  percentage 

•  Simplify  the  requirements  approval  workflow 

•  Improve  quality  of  products  delivered  to  customer 


4.  Define  essential  characteristics  of  the  organization’s  processes. 

Essential  characteristics  of  the  organization’s  processes  are  determined  based  on  the 
following: 

•  Processes  currently  being  used  in  the  organization 

•  Standards  imposed  by  the  organization 

•  Standards  commonly  imposed  by  customers  of  the  organization 
i  Examples  of  process  characteristics  include  the  following: 

:  •  Level  of  detail 
i  •  Process  notation 
j  •  Granularity 

5.  Document  the  organization’s  process  needs  and  objectives. 

6.  Revise  the  organization’s  process  needs  and  objectives  as  needed. 

SP  1.2  Appraise  the  Organization’s  Processes 

Appraise  the  organization’s  processes  periodically  and  as  needed 
to  maintain  an  understanding  of  their  strengths  and  weaknesses. 

:  Process  appraisals  can  be  performed  for  the  following  reasons: 

j  •  To  identify  processes  to  be  improved 

:  •  To  confirm  progress  and  make  the  benefits  of  process  improvement  visible 

i  •  To  satisfy  the  needs  of  a  customer-supplier  relationship 

j  •  To  motivate  and  facilitate  buy-in 


The  buy-in  gained  during  a  process  appraisal  can  be  eroded  significantly  if 
it  is  not  followed  by  an  appraisal  based  action  plan. 

Example  Work  Products 

1 .  Plans  for  the  organization’s  process  appraisals 

2.  Appraisal  findings  that  address  strengths  and  weaknesses  of  the 
organization’s  processes 

3.  Improvement  recommendations  for  the  organization’s  processes 

Subpractices 

1 .  Obtain  sponsorship  of  the  process  appraisal  from  senior  management. 
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Senior  management  sponsorship  includes  the  commitment  to  have  the  organization’s 
managers  and  staff  participate  in  the  process  appraisal  and  to  provide  resources  and 
funding  to  analyze  and  communicate  findings  of  the  appraisal. 

2.  Define  the  scope  of  the  process  appraisal. 

Process  appraisals  can  be  performed  on  the  entire  organization  or  can  be  performed 
on  a  smaller  part  of  an  organization  such  as  a  single  project  or  business  area. 

The  scope  of  the  process  appraisal  addresses  the  following: 

•  Definition  of  the  organization  (e.g.,  sites,  business  areas)  to  be  covered  by  the 
appraisal 

•  Identification  of  the  project  and  support  functions  that  will  represent  the 
organization  in  the  appraisal 

•  Processes  to  be  appraised 

3.  Determine  the  method  and  criteria  to  be  used  for  the  process 
appraisal. 

Process  appraisals  can  occur  in  many  forms.  They  should  address  the  needs  and 
objectives  of  the  organization,  which  can  change  over  time.  For  example,  the  appraisal 
can  be  based  on  a  process  model,  such  as  a  CMMI  model,  or  on  a  national  or 
international  standard,  such  as  ISO  9001  [ISO  2008c],  Appraisals  can  also  be  based 
on  a  benchmark  comparison  with  other  organizations  in  which  practices  that  can 
contribute  to  improved  organizational  performance  are  identified.  The  characteristics  of 
the  appraisal  method  may  vary,  including  time  and  effort,  makeup  of  the  appraisal 
team,  and  the  method  and  depth  of  investigation. 

4.  Plan,  schedule,  and  prepare  for  the  process  appraisal. 

5.  Conduct  the  process  appraisal. 

6.  Document  and  deliver  the  appraisal’s  activities  and  findings. 

SP  1.3  Identify  the  Organization’s  Process  Improvements 

Identify  improvements  to  the  organization’s  processes  and 
process  assets. 


Example  Work  Products 

1 .  Analysis  of  candidate  process  improvements 

2.  Identification  of  improvements  for  the  organization’s  processes 

Subpractices 

1 .  Determine  candidate  process  improvements. 
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Candidate  process  improvements  are  typically  determined  by  doing  the  following: 

•  Measuring  processes  and  analyzing  measurement  results 

•  Reviewing  processes  for  effectiveness  and  suitability 

•  Assessing  customer  satisfaction 

•  Reviewing  lessons  learned  from  tailoring  the  organization’s  set  of  standard 
processes 

•  Reviewing  lessons  learned  from  implementing  processes 

•  Reviewing  process  improvement  proposals  submitted  by  the  organization’s 
managers,  staff,  and  other  relevant  stakeholders 

•  Soliciting  inputs  on  process  improvements  from  senior  management  and  other 
leaders  in  the  organization 

•  Examining  results  of  process  appraisals  and  other  process  related  reviews 

•  Reviewing  results  of  other  organizational  improvement  initiatives 

Candidate  process  improvements  are  also  determined  by  doing  the  following: 

•  Reviewing  process  improvement  proposals  submitted  by  the  organization’s 
suppliers 

•  Obtaining  feedback  from  suppliers  on  acquirer  processes  and  supplier-acquirer 
interface  points 


2.  Prioritize  candidate  process  improvements. 

Criteria  for  prioritization  are  as  follows: 

•  Consider  the  estimated  cost  and  effort  to  implement  the  process  improvements. 

•  Evaluate  the  expected  improvement  against  the  organization’s  improvement 
objectives  and  priorities. 

•  Determine  the  potential  barriers  to  the  process  improvements  and  develop 
strategies  for  overcoming  these  barriers. 

i  Examples  of  techniques  to  help  determine  and  prioritize  possible  improvements  to  be 
i  implemented  include  the  following: 

:  •  A  cost  benefit  analysis  that  compares  the  estimated  cost  and  effort  to  implement 
j  the  process  improvements  and  their  associated  benefits 

j  •  A  gap  analysis  that  compares  current  conditions  in  the  organization  with  optimal 

j  conditions 

j  •  Force  field  analysis  of  potential  improvements  to  identify  potential  barriers  and 
j  strategies  for  overcoming  those  barriers 

:  •  Cause-and-effect  analyses  to  provide  information  on  the  potential  effects  of 
i  different  improvements  that  can  then  be  compared 


3.  Identify  and  document  the  process  improvements  to  be  implemented. 

4.  Revise  the  list  of  planned  process  improvements  to  keep  it  current. 
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SG  2  Plan  and  Implement  Process  Actions 

Process  actions  that  address  improvements  to  the  organization’s  processes 
and  process  assets  are  planned  and  implemented. 

The  successful  implementation  of  improvements  requires  participation  in 
process  action  planning  and  implementation  by  process  owners,  those  who 
perform  the  process,  and  support  organizations. 

SP  2.1  Establish  Process  Action  Plans 

Establish  and  maintain  process  action  plans  to  address 
improvements  to  the  organization’s  processes  and  process  assets. 

:  Establishing  and  maintaining  process  action  plans  typically  involves  the  following  roles: 

:  •  Management  steering  committees  that  set  strategies  and  oversee  process  improvement 
|  activities 

:  •  Process  groups  that  facilitate  and  manage  process  improvement  activities 
i  •  Process  action  teams  that  define  and  implement  process  actions 
:  •  Process  owners  that  manage  deployment 
i  •  Practitioners  that  perform  the  process 


Stakeholder  involvement  helps  to  obtain  buy-in  on  process  improvements 
and  increases  the  likelihood  of  effective  deployment. 

Process  action  plans  are  detailed  implementation  plans.  These  plans  differ 
from  the  organization’s  process  improvement  plan  by  targeting 
improvements  that  were  defined  to  address  weaknesses  and  that  were 
usually  uncovered  by  appraisals. 

Suppliers  can  be  involved  in  developing  process  action  plans  if  the 
processes  that  define  interfaces  between  the  acquirer  and  supplier  are 
targeted  for  improvement. 

Example  Work  Products 

1 .  The  organization’s  approved  process  action  plans 

Subpractices 

1 .  Identify  strategies,  approaches,  and  actions  to  address  identified 
process  improvements. 

New,  unproven,  and  major  changes  are  piloted  before  they  are  incorporated  into 
normal  use. 

2.  Establish  process  action  teams  to  implement  actions. 

The  teams  and  people  performing  the  process  improvement  actions  are  called 
“process  action  teams.”  Process  action  teams  typically  include  process  owners  and 
those  who  perform  the  process. 

Process  action  teams  can  also  include  supplier  representatives  when  suppliers  interact 
with  the  acquirer  process  to  be  improved  or  provide  supplemental  resources  to  the 
acquirer  to  perform  an  acquirer  process. 

3.  Document  process  action  plans. 
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Process  action  plans  typically  cover  the  following: 

•  Process  improvement  infrastructure 

•  Process  improvement  objectives 

•  Process  improvements  to  be  addressed 

•  Procedures  for  planning  and  tracking  process  actions 

•  Strategies  for  piloting  and  implementing  process  actions 

•  Responsibility  and  authority  for  implementing  process  actions 

•  Resources,  schedules,  and  assignments  for  implementing  process  actions 

•  Methods  for  determining  the  effectiveness  of  process  actions 

•  Risks  associated  with  process  action  plans 


4.  Review  and  negotiate  process  action  plans  with  relevant  stakeholders. 

5.  Revise  process  action  plans  as  necessary. 

SP  2.2  Implement  Process  Action  Plans 

Implement  process  action  plans. 


Example  Work  Products 

1 .  Commitments  among  process  action  teams 

2.  Status  and  results  of  implementing  process  action  plans 

3.  Plans  for  pilots 
Subpractices 

1 .  Make  process  action  plans  readily  available  to  relevant  stakeholders. 

2.  Negotiate  and  document  commitments  among  process  action  teams 
and  revise  their  process  action  plans  as  necessary. 

3.  Track  progress  and  commitments  against  process  action  plans. 

4.  Conduct  joint  reviews  with  process  action  teams  and  relevant 
stakeholders  to  monitor  the  progress  and  results  of  process  actions. 

5.  Plan  pilots  needed  to  test  selected  process  improvements. 

6.  Review  the  activities  and  work  products  of  process  action  teams. 

7.  Identify,  document,  and  track  to  closure  issues  encountered  when 
implementing  process  action  plans. 

8.  Ensure  that  results  of  implementing  process  action  plans  satisfy  the 
organization’s  process  improvement  objectives. 

SG  3 _ Deploy  Organizational  Process  Assets  and  Incorporate  Experiences _ 

Organizational  process  assets  are  deployed  across  the  organization  and 
process  related  experiences  are  incorporated  into  organizational  process 
assets. 

The  specific  practices  under  this  specific  goal  describe  ongoing  activities. 
New  opportunities  to  benefit  from  organizational  process  assets  and 
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changes  to  them  can  arise  throughout  the  life  of  each  project.  Deployment 
of  standard  processes  and  other  organizational  process  assets  should  be 
continually  supported  in  the  organization,  particularly  for  new  projects  at 
startup. 

SP  3.1  Deploy  Organizational  Process  Assets 

Deploy  organizational  process  assets  across  the  organization. 

Deploying  organizational  process  assets  or  changes  to  them  should  be 
performed  in  an  orderly  manner.  Some  organizational  process  assets  or 
changes  to  them  may  not  be  appropriate  for  use  in  some  parts  of  the 
organization  (e.g.,  because  of  stakeholder  requirements  or  the  current 
lifecycle  phase  being  implemented).  It  is  therefore  important  that  those  who 
are  or  will  be  executing  the  process,  as  well  as  other  organization  functions 
(e.g.,  training,  quality  assurance),  be  involved  in  deployment  as  necessary. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

Example  Work  Products 

1 .  Plans  for  deploying  organizational  process  assets  and  changes  to 
them  across  the  organization 

2.  Training  materials  for  deploying  organizational  process  assets  and 
changes  to  them 

3.  Documentation  of  changes  to  organizational  process  assets 

4.  Support  materials  for  deploying  organizational  process  assets  and 
changes  to  them 

Subpractices 

1 .  Deploy  organizational  process  assets  across  the  organization. 

:  Typical  activities  performed  as  a  part  of  the  deployment  of  process  assets  include  the 
i  following: 

:  •  Identifying  organizational  process  assets  that  should  be  adopted  by  those  who 
:  perform  the  process 

i  •  Determining  how  organizational  process  assets  are  made  available  (e.g.,  via  a 
j  website) 

|  •  Identifying  how  changes  to  organizational  process  assets  are  communicated 

:  •  Identifying  resources  (e.g.,  methods,  tools)  needed  to  support  the  use  of 
:  organizational  process  assets 

i  •  Planning  the  deployment 

:  •  Assisting  those  who  use  organizational  process  assets 

i_  •  Ensuring  that  training  is  available  for  those  who  use  organizational  process  assets 

Refer  to  the  Organizational  Training  process  area  for  more  information 
about  establishing  an  organizational  training  capability. 

2.  Document  changes  to  organizational  process  assets. 
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Documenting  changes  to  organizational  process  assets  serves  two  main  purposes: 

•  To  enable  the  communication  of  changes 

•  To  understand  the  relationship  of  changes  in  the  organizational  process  assets  to 
changes  in  process  performance  and  results 

3.  Deploy  changes  that  were  made  to  organizational  process  assets 
across  the  organization. 

i  Typical  activities  performed  as  a  part  of  deploying  changes  include  the  following: 
i  •  Determining  which  changes  are  appropriate  for  those  who  perform  the  process 
:  •  Planning  the  deployment 

:  •  Arranging  for  the  support  needed  for  the  successful  transition  of  changes 

4.  Provide  guidance  and  consultation  on  the  use  of  organizational 
process  assets. 

SP  3.2  Deploy  Standard  Processes 

Deploy  the  organization’s  set  of  standard  processes  to  projects  at 
their  startup  and  deploy  changes  to  them  as  appropriate 
throughout  the  life  of  each  project. 

It  is  important  that  new  projects  use  proven  and  effective  processes  to 
perform  critical  early  activities  (e.g.,  project  planning,  receiving 
requirements,  obtaining  resources). 

Projects  should  also  periodically  update  their  defined  processes  to 
incorporate  the  latest  changes  made  to  the  organization’s  set  of  standard 
processes  when  it  will  benefit  them.  This  periodic  update  helps  to  ensure 
that  all  project  activities  derive  the  full  benefit  of  what  other  projects  have 
learned. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  standard  processes  and  establishing  tailoring 
criteria  and  guidelines. 

Example  Work  Products 

1 .  The  organization’s  list  of  projects  and  the  status  of  process  deployment 
on  each  (i.e.,  existing  and  planned  projects) 

2.  Guidelines  for  deploying  the  organization’s  set  of  standard  processes 
on  new  projects 

3.  Records  of  tailoring  and  implementing  the  organization’s  set  of 
standard  processes 

Subpractices 

1 .  Identify  projects  in  the  organization  that  are  starting  up. 

2.  Identify  active  projects  that  would  benefit  from  implementing  the 
organization’s  current  set  of  standard  processes. 

3.  Establish  plans  to  implement  the  organization’s  current  set  of  standard 
processes  on  the  identified  projects. 
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4.  Assist  projects  in  tailoring  the  organization’s  set  of  standard  processes 
to  meet  their  needs. 

Refer  to  the  Integrated  Project  Management  process  area  for  more 
information  about  establishing  the  project’s  defined  process. 

5.  Maintain  records  of  tailoring  and  implementing  processes  on  the 
identified  projects. 

6.  Ensure  that  the  defined  processes  resulting  from  process  tailoring  are 
incorporated  into  plans  for  process  compliance  audits. 

Process  compliance  audits  are  objective  evaluations  of  project  activities  against  the 
project’s  defined  process. 

7.  As  the  organization’s  set  of  standard  processes  is  updated,  identify 
which  projects  should  implement  the  changes. 

SP  3.3  Monitor  the  Implementation 

Monitor  the  implementation  of  the  organization’s  set  of  standard 
processes  and  use  of  process  assets  on  all  projects. 

By  monitoring  implementation,  the  organization  ensures  that  the 
organization’s  set  of  standard  processes  and  other  process  assets  are 
appropriately  deployed  to  all  projects.  Monitoring  implementation  also  helps 
the  organization  to  develop  an  understanding  of  the  organizational  process 
assets  being  used  and  where  they  are  used  in  the  organization.  Monitoring 
also  helps  to  establish  a  broader  context  for  interpreting  and  using  process 
and  product  measures,  lessons  learned,  and  improvement  information 
obtained  from  projects. 

Example  Work  Products 

1 .  Results  of  monitoring  process  implementation  on  projects 

2.  Status  and  results  of  process  compliance  audits 

3.  Results  of  reviewing  selected  process  artifacts  created  as  part  of 
process  tailoring  and  implementation 

Subpractices 

1 .  Monitor  the  projects’  use  of  organizational  process  assets  and  changes 
to  them. 

2.  Review  selected  process  artifacts  created  during  the  life  of  each 
project. 

Reviewing  selected  process  artifacts  created  during  the  life  of  a  project  ensures  that  all 
projects  are  making  appropriate  use  of  the  organization’s  set  of  standard  processes. 

3.  Review  results  of  process  compliance  audits  to  determine  how  well  the 
organization’s  set  of  standard  processes  has  been  deployed. 

Refer  to  the  Process  and  Product  Quality  Assurance  process  area  for 
more  information  about  objectively  evaluating  processes. 

4.  Identify,  document,  and  track  to  closure  issues  related  to  implementing 
the  organization’s  set  of  standard  processes. 
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SP  3.4  Incorporate  Experiences  into  Organizational  Process  Assets 

Incorporate  process  related  experiences  derived  from  planning  and 
performing  the  process  into  organizational  process  assets. 


Example  Work  Products 

1 .  Process  improvement  proposals 

2.  Process  lessons  learned 

3.  Measurements  of  organizational  process  assets 

4.  Improvement  recommendations  for  organizational  process  assets 

5.  Records  of  the  organization’s  process  improvement  activities 

6.  Information  on  organizational  process  assets  and  improvements  to 
them 

Subpractices 

1 .  Conduct  periodic  reviews  of  the  effectiveness  and  suitability  of  the 
organization’s  set  of  standard  processes  and  related  organizational 
process  assets  relative  to  the  process  needs  and  objectives  derived 
from  the  organization’s  business  objectives. 

2.  Obtain  feedback  about  the  use  of  organizational  process  assets. 

3.  Derive  lessons  learned  from  defining,  piloting,  implementing,  and 
deploying  organizational  process  assets. 

4.  Make  lessons  learned  available  to  people  in  the  organization  as 
appropriate. 

Actions  may  be  necessary  to  ensure  that  lessons  learned  are  used  appropriately. 

:  Examples  of  the  inappropriate  use  of  lessons  learned  include  the  following: 

:  •  Evaluating  the  performance  of  people 
:  •  Judging  process  performance  or  results 

i - 

i  Examples  of  ways  to  prevent  the  inappropriate  use  of  lessons  learned  include  the 
|  following: 

■  •  Controlling  access  to  lessons  learned 
:  •  Educating  people  about  the  appropriate  use  of  lessons  learned 

5.  Analyze  measurement  data  obtained  from  the  use  of  the  organization’s 
common  set  of  measures. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  analyzing  measurement  data. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  the  organization’s  measurement 
repository. 

6.  Appraise  processes,  methods,  and  tools  in  use  in  the  organization  and 
develop  recommendations  for  improving  organizational  process  assets. 
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This  appraisal  typically  includes  the  following: 

•  Determining  which  processes,  methods,  and  tools  are  of  potential  use  to  other 
parts  of  the  organization 

•  Appraising  the  quality  and  effectiveness  of  organizational  process  assets 

•  Identifying  candidate  improvements  to  organizational  process  assets 

•  Determining  compliance  with  the  organization’s  set  of  standard  processes  and 
tailoring  guidelines 


7.  Make  the  best  of  the  organization’s  processes,  methods,  and  tools 
available  to  people  in  the  organization  as  appropriate. 

8.  Manage  process  improvement  proposals. 

Process  improvement  proposals  can  address  both  process  and  technology 
improvements. 

■  The  activities  for  managing  process  improvement  proposals  typically  include  the 
i  following: 

:  •  Soliciting  process  improvement  proposals 
:  •  Collecting  process  improvement  proposals 
:  •  Reviewing  process  improvement  proposals 
i  •  Selecting  the  process  improvement  proposals  to  be  implemented 
•  Tracking  the  implementation  of  process  improvement  proposals 


Process  improvement  proposals  are  documented  as  process  change  requests  or 
problem  reports  as  appropriate. 

Some  process  improvement  proposals  can  be  incorporated  into  the  organization’s 
process  action  plans. 

9.  Establish  and  maintain  records  of  the  organization’s  process 
improvement  activities. 
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ORGANIZATIONAL  PERFORMANCE  MANAGEMENT 

A  Process  Management  Process  Area  at  Maturity  Level  5 


Purpose 


The  purpose  of  Organizational  Performance  Management  (OPM)  is  to 
proactively  manage  the  organization’s  performance  to  meet  its  business 
objectives. 


Introductory  Notes 


The  Organizational  Performance  Management  process  area  enables  the 
organization  to  manage  organizational  performance  by  iteratively  analyzing 
aggregated  project  data,  identifying  gaps  in  performance  against  the 
business  objectives,  and  selecting  and  deploying  improvements  to  close  the 
gaps. 

In  this  process  area,  the  term  “improvement”  includes  all  incremental  and 
innovative  process  and  technology  improvements,  including  those 
improvements  made  to  project  work  environments.  “Improvement”  refers  to 
all  ideas  that  would  change  the  organization’s  processes,  technologies,  and 
performance  to  better  meet  the  organization’s  business  objectives  and 
associated  quality  and  process  performance  objectives. 

Business  objectives  that  this  process  area  might  address  include  the 
following: 

•  Improved  product  quality  (e.g.,  functionality,  quality  attributes) 

•  Increased  productivity 

•  Increased  process  efficiency  and  effectiveness 

•  Increased  consistency  in  meeting  budget  and  schedule 

•  Decreased  cycle  time 

•  Greater  customer  and  end-user  satisfaction 

•  Shorter  development  or  production  time  to  change  functionality,  add 
new  features,  or  adapt  to  new  technologies 

•  Improved  performance  of  a  supply  chain  involving  multiple  suppliers 

•  Improved  use  of  resources  across  the  organization 

The  organization  analyzes  product  and  process  performance  data  from  the 
projects  to  determine  if  it  is  capable  of  meeting  the  quality  and  process 
performance  objectives.  Process  performance  baselines  and  process 
performance  models,  developed  using  Organizational  Process  Performance 
processes,  are  used  as  part  of  the  analysis.  Causal  Analysis  and 
Resolution  processes  can  also  be  used  to  identify  potential  areas  of 
improvement  or  specific  improvement  proposals. 
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The  organization  identifies  and  proactively  solicits  incremental  and 
innovative  improvements  from  within  the  organization  and  from  external 
sources  such  as  academia,  competitive  intelligence,  and  successful 
improvements  implemented  elsewhere. 

Realization  of  the  improvements  and  their  effects  on  the  quality  and 
process  performance  objectives  depends  on  being  able  to  effectively 
identify,  evaluate,  implement,  and  deploy  improvements  to  the 
organization’s  processes  and  technologies. 

Realization  of  the  improvements  and  beneficial  effects  also  depends  on 
engaging  the  workforce  in  identifying  and  evaluating  possible  improvements 
and  maintaining  a  focus  on  long-term  planning  that  includes  the 
identification  of  innovations. 

Improvements  can  be  identified  and  executed  by  the  acquirer  or  the 
supplier.  The  acquirer  encourages  all  suppliers  to  participate  in  the 
acquirer’s  process  and  technology  improvement  activities.  Some  selected 
improvements  can  be  deployed  across  acquirer  and  supplier  organizations. 

The  acquirer  and  suppliers  may  share  the  costs  and  benefits  of 
improvements.  Acquirers  may  increase  the  incentive  for  suppliers  to 
participate  in  improvement  efforts  across  the  supply  chain  by  allowing 
suppliers  to  appropriate  the  entire  value  derived  from  a  contributed 
improvement  for  an  initial  period  (e.g.,  6  to  18  months).  Over  time,  the 
supplier  may  be  expected  to  share  a  proportion  of  those  savings  with  the 
acquirer  (e.g.,  through  cost  reductions  to  the  acquirer).  Acquirer  and 
supplier  expectations  related  to  participation  in  process  and  technology 
improvement  activities,  and  the  sharing  of  associated  costs  and  benefits, 
should  be  documented  in  the  supplier  agreement. 

Improvement  proposals  are  evaluated  and  validated  for  their  effectiveness 
in  the  target  environment.  Based  on  this  evaluation,  improvements  are 
prioritized  and  selected  for  deployment  to  new  and  ongoing  projects. 
Deployment  is  managed  in  accordance  with  the  deployment  plan  and 
performance  data  are  analyzed  using  statistical  and  other  quantitative 
techniques  to  determine  the  effects  of  the  improvement  on  quality  and 
process  performance  objectives. 

This  improvement  cycle  continually  optimizes  organizational  processes 
based  on  quality  and  process  performance  objectives.  Business  objectives 
are  periodically  reviewed  to  ensure  they  are  current  and  quality  and  process 
performance  objectives  are  updated  as  appropriate. 

The  Organizational  Process  Focus  process  area  includes  no  assumptions 
about  the  quantitative  basis  for  identifying  improvements,  nor  their  expected 
results.  This  process  area  extends  the  Organizational  Process  Focus 
practices  by  focusing  on  process  improvement  based  on  a  quantitative 
understanding  of  the  organization’s  set  of  standard  processes  and 
technologies  and  their  expected  quality  and  process  performance. 

The  specific  practices  of  this  process  area  apply  to  organizations  whose 
projects  are  quantitatively  managed.  Use  of  the  specific  practices  of  this 
process  area  can  add  value  in  other  situations,  but  the  results  may  not 
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provide  the  same  degree  of  impact  to  the  organization’s  quality  and  process 
performance  objectives. 

Related  Process  Areas 


Refer  to  the  Causal  Analysis  and  Resolution  process  area  for  more 
information  about  identifying  causes  of  selected  outcomes  and  taking  action 
to  improve  process  performance. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal  evaluation 
process  that  evaluates  identified  alternatives  against  established  criteria. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  aligning  measurement  and  analysis  activities  and  providing 
measurement  results. 

Refer  to  the  Organizational  Process  Focus  process  area  for  more 
information  about  planning,  implementing,  and  deploying  organizational 
process  improvements  based  on  a  thorough  understanding  of  current 
strengths  and  weaknesses  of  the  organization’s  processes  and  process 
assets. 

Refer  to  the  Organizational  Process  Performance  process  area  for  more 
information  about  establishing  quality  and  process  performance  objectives 
and  establishing  process  performance  baselines  and  models. 

Refer  to  the  Organizational  Training  process  area  for  more  information 
about  providing  training. 

Specific  Goal  and  Practice  Summary 

SG  1  Manage  Business  Performance 

SP1.1  Maintain  Business  Objectives 
SP  1 .2  Analyze  Process  Performance  Data 

SP  1 .3  Identify  Potential  Areas  for  Improvement 

SG  2  Select  Improvements 

SP  2.1  Elicit  Suggested  Improvements 
SP  2.2  Analyze  Suggested  Improvements 

SP  2.3  Validate  Improvements 

SP  2.4  Select  and  Implement  Improvements  for  Deployment 
SG  3  Deploy  Improvements 

SP  3.1  Plan  the  Deployment 

SP  3.2  Manage  the  Deployment 

SP  3.3  Evaluate  Improvement  Effects 

Specific  Practices  by  Goal 


SG  1  Manage  Business  Performance 

The  organization’s  business  performance  is  managed  using  statistical  and 
other  quantitative  techniques  to  understand  process  performance  shortfalls, 
and  to  identify  areas  for  process  improvement. 

Managing  business  performance  requires  the  following: 
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•  Maintaining  the  organization’s  business  objectives 

•  Understanding  the  organization’s  ability  to  meet  the  business  objectives 

•  Continually  improving  processes  related  to  achieving  the  business 
objectives 

The  organization  uses  defined  process  performance  baselines  to  determine 
if  the  current  and  projected  organizational  business  objectives  are  being 
met.  Shortfalls  in  process  performance  are  identified  and  analyzed  to 
determine  potential  areas  for  process  improvement. 

Refer  to  the  Organizational  Process  Performance  process  area  for  more 
information  about  establishing  performance  baselines  and  models. 

As  the  organization  improves  its  process  performance  or  as  business 
strategies  change,  new  business  objectives  are  identified  and  associated 
quality  and  process  performance  objectives  are  derived. 

Specific  goal  2  addresses  eliciting  and  analyzing  improvement  suggestions 
that  address  shortfalls  in  achieving  quality  and  process  performance 
objectives. 

SP1.1  Maintain  Business  Objectives 

Maintain  business  objectives  based  on  an  understanding  of 
business  strategies  and  actual  performance  results. 

Organizational  performance  data,  characterized  by  process  performance 
baselines,  are  used  to  evaluate  whether  business  objectives  are  realistic 
and  aligned  with  business  strategies.  After  business  objectives  have  been 
revised  and  prioritized  by  senior  management,  quality  and  process 
performance  objectives  may  need  to  be  created  or  maintained  and  re¬ 
communicated. 

Example  Work  Products 

1.  Revised  business  objectives 

2.  Revised  quality  and  process  performance  objectives 

3.  Senior  management  approval  of  revised  business  objectives  and 
quality  and  process  performance  objectives 

4.  Communication  of  all  revised  objectives 

5.  Updated  process  performance  measures 

Subpractices 

1 .  Evaluate  business  objectives  periodically  to  ensure  they  are  aligned 
with  business  strategies. 

Senior  management  is  responsible  for  understanding  the  marketplace,  establishing 
business  strategies,  and  establishing  business  objectives. 

Because  business  strategies  and  organizational  performance  evolve,  business 
objectives  should  be  reviewed  periodically  to  determine  whether  they  should  be 
updated.  For  example,  a  business  objective  might  be  retired  when  process 
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performance  data  show  that  the  business  objective  is  being  met  consistently  over  time 
or  when  the  associated  business  strategy  has  changed, 

2.  Compare  business  objectives  with  actual  process  performance  results 
to  ensure  they  are  realistic. 

Business  objectives  can  set  the  bar  too  high  to  motivate  real  improvement.  Using 
process  performance  baselines  helps  balance  desires  and  reality. 

If  process  performance  baselines  are  unavailable,  sampling  techniques  can  be  used  to 
develop  a  quantitative  basis  for  comparison  in  a  short  period  of  time. 

3.  Prioritize  business  objectives  based  on  documented  criteria,  such  as 
the  ability  to  win  new  business,  retain  existing  clients,  or  accomplish 
other  key  business  strategies. 

4.  Maintain  quality  and  process  performance  objectives  to  address 
changes  in  business  objectives. 

Business  objectives  and  quality  and  process  performance  objectives  will  typically 
evolve  over  time.  As  existing  objectives  are  achieved,  they  will  be  monitored  to  ensure 
they  continue  to  be  met,  while  new  business  objectives  and  associated  quality  and 
process  performance  objectives  are  identified  and  managed. 

Refer  to  the  Organizational  Process  Performance  process  area  for 
more  information  about  establishing  quality  and  process  performance 
objectives. 

5.  Revise  process  performance  measures  to  align  with  quality  and 
process  performance  objectives. 

Refer  to  the  Organizational  Process  Performance  process  area  for 
more  information  about  establishing  process  performance  measures. 

SP  1.2  Analyze  Process  Performance  Data 

Analyze  process  performance  data  to  determine  the  organization’s 
ability  to  meet  identified  business  objectives. 

The  data  that  result  from  applying  the  process  performance  measures, 
which  are  defined  using  Organizational  Process  Performance  processes, 
are  analyzed  to  create  process  performance  baselines  that  help  in 
understanding  the  current  capability  of  the  organization.  Comparing  process 
performance  baselines  to  quality  and  process  performance  objectives  helps 
the  organization  to  determine  its  ability  to  meet  business  objectives.  This 
data  typically  are  collected  from  project  level  process  performance  data  to 
enable  organizational  analysis. 

Example  Work  Products 

1 .  Analysis  of  current  capability  vs.  business  objectives 

2.  Process  performance  shortfalls 

3.  Risks  associated  with  meeting  business  objectives 
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Subpractices 

1 .  Periodically  compare  quality  and  process  performance  objectives  to 
current  process  performance  baselines  to  evaluate  the  ability  of  the 
organization  to  meet  its  business  objectives. 

For  example,  if  cycle  time  is  a  critical  business  need,  many  different  cycle  time 
measures  may  be  collected  by  the  organization.  Overall  cycle  time  performance  data 
should  be  compared  to  the  business  objectives  to  understand  if  expected  performance 
will  satisfy  business  objectives. 

2.  Identify  shortfalls  where  the  actual  process  performance  is  not 
satisfying  the  business  objectives. 

3.  Identify  and  analyze  risks  associated  with  not  meeting  business 
objectives. 

4.  Report  results  of  the  process  performance  and  risk  analyses  to 
organizational  leadership. 

SP  1.3  Identify  Potential  Areas  for  Improvement 

Identify  potential  areas  for  improvement  that  could  contribute  to 
meeting  business  objectives. 

Potential  areas  for  improvement  are  identified  through  a  proactive  analysis 
to  determine  areas  that  could  address  process  performance  shortfalls. 
Causal  Analysis  and  Resolution  processes  can  be  used  to  diagnose  and 
resolve  root  causes. 

The  output  from  this  activity  is  used  to  evaluate  and  prioritize  potential 
improvements,  and  can  result  in  either  incremental  or  innovative 
improvement  suggestions  as  described  in  specific  goal  2. 

Example  Work  Products 

1 .  Potential  areas  for  improvement 

Subpractices 

1 .  Identify  potential  improvement  areas  based  on  the  analysis  of  process 
performance  shortfalls. 

Performance  shortfalls  include  not  meeting  productivity,  cycle  time,  or  customer 
satisfaction  objectives.  Examples  of  areas  to  consider  for  improvement  include  product 
technology,  process  technology,  staffing  and  staff  development,  team  structures, 
supplier  selection  and  management,  and  other  organizational  infrastructures. 

2.  Document  the  rationale  for  the  potential  improvement  areas,  including 
references  to  applicable  business  objectives  and  process  performance 
data. 

3.  Document  anticipated  costs  and  benefits  associated  with  addressing 
potential  improvement  areas. 

4.  Communicate  the  set  of  potential  improvement  areas  for  further 
evaluation,  prioritization,  and  use. 
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SG  2 _ Select  Improvements _ 

Improvements  are  proactively  identified,  evaluated  using  statistical  and  other 
quantitative  techniques,  and  selected  for  deployment  based  on  their 
contribution  to  meeting  quality  and  process  performance  objectives. 

Improvements  to  be  deployed  across  the  organization  are  selected  from 
improvement  suggestions  which  have  been  evaluated  for  effectiveness  in 
the  target  deployment  environment.  These  improvement  suggestions  are 
elicited  and  submitted  from  across  the  organization  to  address  the 
improvement  areas  identified  in  specific  goal  1 . 

Evaluations  of  improvement  suggestions  are  based  on  the  following: 

•  A  quantitative  understanding  of  the  organization’s  current  quality  and 
process  performance 

•  Satisfaction  of  the  organization’s  quality  and  process  performance 
objectives 

•  Estimated  costs  and  impacts  of  developing  and  deploying  the 
improvements,  resources,  and  funding  available  for  deployment 

•  Estimated  benefits  in  quality  and  process  performance  resulting  from 
deploying  the  improvements 

SP  2.1  Elicit  Suggested  Improvements 

Elicit  and  categorize  suggested  improvements. 

This  practice  focuses  on  eliciting  suggested  improvements  and  includes 
categorizing  suggested  improvements  as  incremental  or  innovative. 

Incremental  improvements  generally  originate  with  those  who  do  the  work 
(i.e. ,  users  of  the  process  or  technology).  Incremental  improvements  can  be 
simple  and  inexpensive  to  implement  and  deploy.  Incremental  improvement 
suggestions  are  analyzed,  but,  if  selected,  may  not  need  rigorous  validation 
or  piloting.  Innovative  improvements  such  as  new  or  redesigned  processes 
are  more  transformational  than  incremental  improvements. 

Innovative  improvements  often  arise  out  of  a  systematic  search  for 
solutions  to  particular  performance  issues  or  opportunities  to  improve 
performance.  They  are  identified  by  those  who  are  trained  and  experienced 
with  the  maturation  of  particular  technologies  or  whose  job  it  is  to  track  or 
directly  contribute  to  increased  performance. 

Innovations  can  be  found  externally  by  actively  monitoring  innovations  used 
in  other  organizations  or  documented  in  the  research  literature.  Innovations 
can  also  be  found  by  looking  internally  (e.g.,  by  examining  project  lessons 
learned).  Innovations  are  inspired  by  the  need  to  achieve  quality  and 
process  performance  objectives,  the  need  to  improve  performance 
baselines,  or  the  external  business  environment. 

The  acquirer  should  continuously  improve  its  processes  and  its  alignment 
with  its  customer  and  suppliers.  The  acquirer  may  look  for  opportunities  to 
maximize  throughput  based  on  the  identification  of  the  most  limiting 
resource  and,  as  a  result,  create  a  more  agile  supply  chain  (e.g.,  giving 
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higher  priority  to  improvement  proposals  that  promote  a  supply  chain  that 
responds  both  quickly  and  cost  effectively). 

:  An  example  of  an  incremental  improvement  is  to  establish  guidelines  for  multiple  supplier 
:  interactions. 

l . 


Some  suggested  improvements  may  be  received  in  the  form  of  a  proposal 
(e.g.,  an  organizational  improvement  proposal  arising  from  a  causal 
analysis  and  resolution  activity).  These  suggested  improvements  will  have 
been  analyzed  and  documented  prior  to  input  to  Organizational 
Performance  Management  processes.  When  suggested  improvements  are 
received  as  proposals,  the  proposals  are  reviewed  for  completeness  and 
are  evaluated  as  part  of  the  selection  process  for  implementation. 

Improvement  searches  can  involve  looking  outside  the  organization, 
deriving  innovations  from  projects  using  Causal  Analysis  and  Resolution 
processes,  using  competitive  business  intelligence,  or  analyzing  existing 
organizational  performance. 

Example  Work  Products 

1.  Suggested  incremental  improvements 

2.  Suggested  innovative  improvements 

Example  Supplier  Deliverables 

1 .  Process  and  technology  improvement  proposals 

Subpractices 

1 .  Elicit  suggested  improvements. 

These  suggestions  document  potential  improvements  to  processes  and  technologies. 
Managers  and  staff  in  the  organization  as  well  as  customers,  end  users,  and  suppliers 
can  submit  suggestions.  The  organization  can  also  search  the  academic  and 
technology  communities  for  suggested  improvements.  Some  suggested  improvements 
may  have  been  implemented  at  the  project  level  before  being  proposed  for  the 
organization. 
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Examples  of  sources  for  improvements  include  the  following: 

•  Findings  and  recommendations  from  process  appraisals 

•  The  organization’s  quality  and  process  performance  objectives 

•  Analysis  of  data  about  customer  and  end-user  problems  as  well  as  customer  and 
end-user  satisfaction 

•  Results  of  process  and  product  benchmarking  efforts 

•  Measured  effectiveness  of  process  activities 

•  Measured  effectiveness  of  project  work  environments 

•  Examples  of  improvements  that  were  successfully  adopted  elsewhere 

•  Feedback  on  previous  improvements 

•  Spontaneous  ideas  from  managers  and  staff 

•  Improvement  proposals  from  Causal  Analysis  and  Resolution  processes  resulting 
from  implemented  actions  with  proven  effectiveness 

•  Analysis  of  data  on  defect  causes 

•  Analysis  of  technical  performance  measures 

•  Templates  for  acquirer  work  products 

•  Findings  and  recommendations  from  joint  acquirer  and  supplier  study  groups 

•  Analysis  of  project  and  organizational  performance  compared  to  quality  and 
productivity  objectives 


Refer  to  the  Organizational  Process  Focus  process  area  for  more 
information  about  deploying  organizational  process  assets  and 
incorporating  experiences. 

2.  Identify  suggested  improvements  as  incremental  or  innovative. 

3.  Investigate  innovative  improvements  that  may  improve  the 
organization's  processes  and  technologies. 

:  Investigating  innovative  improvements  typically  involves  the  following: 

:  •  Maintaining  awareness  of  leading  relevant  technical  work  and  technology  trends 
j  •  Searching  for  commercially  available  innovative  improvements 

j  •  Collecting  proposals  for  innovative  improvements  from  the  projects  and  the 
j  organization 

:  •  Reviewing  processes  and  technologies  used  externally  and  comparing  them  to  the 
j  processes  and  technologies  used  in  the  organization 

i  •  Identifying  areas  where  innovative  improvements  have  been  used  successfully, 
i  and  reviewing  data  and  documentation  of  experience  using  these  improvements 

:  •  Identifying  improvements  that  integrate  new  technology  into  products  and  project 
:  work  environments 
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SP  2.2  Analyze  Suggested  Improvements 

Analyze  suggested  improvements  for  their  possible  impact  on 
achieving  the  organization’s  quality  and  process  performance 
objectives. 

Suggested  improvements  are  incremental  and  innovative  improvements 
that  are  analyzed  and  possibly  selected  for  validation,  implementation,  and 
deployment  throughout  the  organization. 

Example  Work  Products 

1 .  Suggested  improvement  proposals 

2.  Selected  improvements  to  be  validated 

Subpractices 

1 .  Analyze  the  costs  and  benefits  of  suggested  improvements. 

Process  performance  models  provide  insight  into  the  effect  of  process  changes  on 
process  capability  and  performance. 

Refer  to  the  Organizational  Process  Performance  process  area  for 
more  information  about  establishing  process  performance  models. 

Improvement  suggestions  that  have  a  large  cost-to-benefit  ratio  or  that  would  not 
improve  the  organization’s  processes  may  be  rejected. 

i  Criteria  for  evaluating  costs  and  benefits  include  the  following: 

:  •  Contribution  toward  meeting  the  organization’s  quality  and  process  performance 
i  objectives 

j  •  Effect  on  mitigating  identified  project  and  organizational  risks 

:  •  Ability  to  respond  quickly  to  changes  in  project  requirements,  market  situations, 
j  and  the  business  environment 

j  •  Effect  on  related  processes  and  associated  assets 

:  •  Cost  of  defining  and  collecting  data  that  support  the  measurement  and  analysis  of 
i  the  process  and  technology  improvement 

i_  •  Expected  life  span  of  the  improvement 


2.  Identify  potential  barriers  and  risks  to  deploying  each  suggested 
improvement. 

j  Examples  of  barriers  to  deploying  improvements  include  the  following: 

j  •  Turf  guarding  and  parochial  perspectives 

j  •  Unclear  or  weak  business  rationale 

j  •  Lack  of  short-term  benefits  and  visible  successes 

:  •  Unclear  picture  of  what  is  expected  from  everyone 

:  •  Too  many  changes  at  the  same  time 

i  •  Lack  of  involvement  and  support  from  relevant  stakeholders 
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Examples  of  risk  factors  that  affect  the  deployment  of  improvements  include  the 
following: 

•  Compatibility  of  the  improvement  with  existing  processes,  values,  and  skills  of 
potential  end  users 

•  Complexity  of  the  improvement 

•  Difficulty  implementing  the  improvement 

•  Ability  to  demonstrate  the  value  of  the  improvement  before  widespread  deployment 

•  Justification  for  large,  up-front  investments  in  areas  such  as  tools  and  training 

•  Inability  to  overcome  “technology  drag”  where  the  current  implementation  is  used 
successfully  by  a  large  and  mature  installed  base  of  end  users 

•  Additional  cost  to  the  customer  or  supplier 

•  Misalignment  of  customer,  acquirer,  and  supplier  improvement  priorities 


3.  Estimate  the  cost,  effort,  and  schedule  required  for  implementing, 
verifying,  and  deploying  each  suggested  improvement. 

4.  Select  suggested  improvements  for  validation  and  possible 
implementation  and  deployment  based  on  the  evaluations. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal 
evaluation  process  that  evaluates  identified  alternatives  against 
established  criteria. 

5.  Document  the  evaluation  results  of  each  selected  improvement 
suggestion  in  an  improvement  proposal. 

The  proposal  should  include  a  problem  statement,  a  plan  (including  cost  and  schedule, 
risk  handling,  method  for  evaluating  effectiveness  in  the  target  environment)  for 
implementing  the  improvement,  and  quantitative  success  criteria  for  evaluating  actual 
results  of  the  deployment. 

6.  Determine  the  detailed  changes  needed  to  implement  the  improvement 
and  document  them  in  the  improvement  proposal. 

7.  Determine  the  validation  method  that  will  be  used  before  broad-scale 
deployment  of  the  change  and  document  it  in  the  improvement 
proposal. 

Determining  the  validation  method  includes  defining  the  quantitative  success  criteria 
that  will  be  used  to  evaluate  results  of  the  validation. 

Since  innovations,  by  definition,  represent  a  major  change  with  high  impact,  most 
innovative  improvements  will  be  piloted.  Other  validation  methods,  including  modeling 
and  simulation  can  be  used  as  appropriate. 

8.  Document  results  of  the  selection  process. 

i  Results  of  the  selection  process  usually  include  the  following: 

:  •  The  disposition  of  each  suggested  improvement 

j_  •  The  rationale  for  the  disposition  of  each  suggested  improvement 
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SP  2.3  Validate  Improvements 

Validate  selected  improvements. 

Selected  improvements  are  validated  in  accordance  with  their  improvement 
proposals. 

:  Examples  of  validation  methods  include  the  following: 

:  •  Discussions  with  stakeholders,  perhaps  in  the  context  of  a  formal  review 

i  •  Prototype  demonstrations 

i  •  Pilots  of  suggested  improvements 

:  •  Modeling  and  simulation 


Pilots  can  be  conducted  to  evaluate  significant  changes  involving  untried, 
high-risk,  or  innovative  improvements  before  they  are  broadly  deployed.  Not 
all  improvements  need  the  rigor  of  a  pilot.  Criteria  for  selecting 
improvements  for  piloting  are  defined  and  used.  Factors  such  as  risk, 
transformational  nature  of  change,  or  number  of  functional  areas  affected 
will  determine  the  need  for  a  pilot  of  the  improvement. 

Red-lined  or  rough-draft  process  documentation  can  be  made  available  for 
use  in  piloting. 

Example  Work  Products 

1.  Validation  plans 

2.  Validation  evaluation  reports 

3.  Documented  lessons  learned  from  validation 

Example  Supplier  Deliverables 

1 .  Pilot  evaluation  reports  for  pilots  executed  in  the  supplier  environment 

2.  Documented  lessons  learned  from  pilots  executed  in  the  supplier 
environment 

Subpractices 

1.  Plan  the  validation. 

Quantitative  success  criteria  documented  in  the  improvement  proposal  can  be  useful 
when  planning  validation. 

Validation  plans  for  selected  improvements  to  be  piloted  should  include  target  projects, 
project  characteristics,  a  schedule  for  reporting  results,  and  measurement  activities 

2.  Review  and  get  relevant  stakeholder  agreement  on  validation  plans. 

3.  Consult  with  and  assist  those  who  perform  the  validation. 

4.  Create  a  trial  implementation,  in  accordance  with  the  validation  plan, 
for  selected  improvements  to  be  piloted. 

5.  Perform  each  validation  in  an  environment  that  is  similar  to  the 
environment  present  in  a  broad  scale  deployment. 

6.  Track  validation  against  validation  plans. 
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7.  Review  and  document  the  results  of  validation. 

Validation  results  are  evaluated  using  the  quantitative  criteria  defined  in  the 
improvement  proposal. 

|  Reviewing  and  documenting  results  of  pilots  typically  involves  the  following  activities: 

|  •  Reviewing  pilot  results  with  stakeholders 

:  •  Deciding  whether  to  terminate  the  pilot,  rework  implementation  of  the 
:  improvement,  replan  and  continue  the  pilot,  or  proceed  with  deployment 

i  •  Updating  the  disposition  of  improvement  proposals  associated  with  the  pilot 
:  •  Identifying  and  documenting  new  improvement  proposals  as  appropriate 

:  •  Identifying  and  documenting  lessons  learned  and  problems  encountered  during  the 
j  pilot  including  feedback  to  the  improvement  team  and  changes  to  the  improvement 


SP  2.4  Select  and  Implement  Improvements  for  Deployment 

Select  and  implement  improvements  for  deployment  throughout 
the  organization  based  on  an  evaluation  of  costs,  benefits,  and 
other  factors. 

Selection  of  suggested  improvements  for  deployment  is  based  on  cost-to- 
benefit  ratios  with  regard  to  quality  and  process  performance  objectives, 
available  resources,  and  the  results  of  improvement  proposal  evaluation 
and  validation  activities. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal  evaluation 
process  that  evaluates  identified  alternatives  against  established  criteria. 

Example  Work  Products 

1 .  Improvements  selected  for  deployment 

2.  Updated  process  documentation  and  training 

Subpractices 

1 .  Prioritize  improvements  for  deployment. 

The  priority  of  an  improvement  is  based  on  an  evaluation  of  its  estimated  cost-to- 
benefit  ratio  with  regard  to  the  quality  and  process  performance  objectives  as 
compared  to  the  performance  baselines.  Return  on  investment  can  be  used  as  a  basis 
of  comparison. 

2.  Select  improvements  to  be  deployed. 

Selection  of  improvements  to  be  deployed  is  based  on  their  priorities,  available 
resources,  and  results  of  improvement  proposal  evaluation  and  validation  activities. 

3.  Determine  how  to  deploy  each  improvement. 
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SG  3 


Examples  of  where  the  improvements  may  be  deployed  include  the  following: 

•  Project  specific  or  common  work  environments 

•  Product  families 

•  Organization’s  projects 

•  Organizational  groups 


4.  Document  results  of  the  selection  process. 

j  Results  of  the  selection  process  usually  include  the  following: 

:  •  The  selection  criteria  for  suggested  improvements 

:  •  The  characteristics  of  the  target  projects 

:  •  The  disposition  of  each  improvement  proposal 

i_  •  The  rationale  for  the  disposition  of  each  improvement  proposal 

5.  Review  any  changes  needed  to  implement  the  improvements. 

:  Examples  of  changes  needed  to  deploy  an  improvement  include  the  following: 

:  •  Process  descriptions,  standards,  and  procedures 
j  •  Work  environments 
j  •  Education  and  training 
|  •  Skills 

j  •  Existing  commitments 
:  •  Existing  activities 
i  •  Continuing  support  to  end  users 
:  •  Organizational  culture  and  characteristics 

6.  Update  the  organizational  process  assets. 

i  Updating  the  organizational  process  assets  typically  includes  reviewing  them,  gaining 
:  approval  for  them,  and  communicating_  them. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

Deploy  Improvements 

Measurable  improvements  to  the  organization’s  processes  and  technologies 
are  deployed  and  evaluated  using  statistical  and  other  quantitative 
techniques. 

Once  improvements  are  selected  for  deployment,  a  plan  for  deployment  is 
created  and  executed.  The  deployment  of  improvements  is  managed  and 
the  effects  of  the  improvements  are  measured  and  evaluated  as  to  how  well 
they  contribute  to  meeting  quality  and  process  performance  objectives. 


228 


Organizational  Performance  Management  (OPM) 


CMMI  for  Acquisition,  Version  1.3 


SP  3.1  Plan  the  Deployment 

Establish  and  maintain  plans  for  deploying  selected  improvements. 

The  plans  for  deploying  selected  improvements  can  be  included  in  the  plan 
for  organizational  performance  management,  in  improvement  proposals,  or 
in  separate  deployment  documents. 

An  acquirer’s  plans  for  deploying  improvements  can  include  openly  sharing 
most  process  knowledge  and  expertise  with  its  suppliers.  Any  process 
related  knowledge  that  the  acquirer  or  one  of  its  suppliers  possesses  is 
viewed  as  accessible  to  virtually  any  other  supplier  in  the  acquirer’s  supply 
chain  (perhaps  with  the  exception  of  a  direct  competitor). 

This  specific  practice  complements  the  Deploy  Organizational  Process 
Assets  specific  practice  in  the  Organizational  Process  Focus  process  area 
and  adds  the  use  of  quantitative  data  to  guide  the  deployment  and  to 
determine  the  value  of  improvements. 

Refer  to  the  Organizational  Process  Focus  process  area  for  more 
information  about  deploying  organizational  process  assets  and 
incorporating  experiences. 

Example  Work  Products 

1 .  Deployment  plans  for  selected  improvements 

Subpractices 

1 .  Determine  how  each  improvement  should  be  adjusted  for  deployment. 

Improvements  identified  in  a  limited  context  (e.g.,  for  a  single  improvement  proposal) 
might  need  to  be  modified  for  a  selected  portion  of  the  organization. 

2.  Identify  strategies  that  address  the  potential  barriers  to  deploying  each 
improvement  that  were  defined  in  the  improvement  proposals. 

3.  Identify  the  target  project  population  for  deployment  of  the 
improvement. 

Not  all  projects  are  good  candidates  for  all  improvements.  For  example,  improvements 
may  be  targeted  to  software  only  projects,  COTS  integration  projects,  or  operations 
and  support  projects. 

4.  Establish  measures  and  objectives  for  determining  the  value  of  each 
improvement  with  respect  to  the  organization’s  quality  and  process 
performance  objectives. 

Measures  can  be  based  on  the  quantitative  success  criteria  documented  in  the 
improvement  proposal  or  derived  from  organizational  objectives. 
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Examples  of  measures  for  determining  the  value  of  an  improvement  include  the 
following: 

•  Measured  improvement  in  the  project’s  or  organization’s  process  performance 

•  Time  to  recover  the  cost  of  the  improvement 

•  Number  and  types  of  project  and  organizational  risks  mitigated  by  the  process  or 
technology  improvement 

•  Average  time  required  to  respond  to  changes  in  project  requirements,  market 
situations,  and  the  business  environment 


Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  aligning  measurement  and  analysis  activities  and 
providing  measurement  results. 

5.  Document  the  plans  for  deploying  selected  improvements. 

The  deployment  plans  should  include  relevant  stakeholders,  risk  strategies,  target 
projects,  measures  of  success,  and  schedule. 

6.  Review  and  get  agreement  with  relevant  stakeholders  on  the  plans  for 
deploying  selected  improvements. 

Relevant  stakeholders  include  the  improvement  sponsor,  target  projects,  support 
organizations,  etc. 

7.  Revise  the  plans  for  deploying  selected  improvements  as  necessary. 

SP  3.2  Manage  the  Deployment 

Manage  the  deployment  of  selected  improvements. 

This  specific  practice  can  overlap  with  the  Implement  Action  Proposals 
specific  practice  in  the  Causal  Analysis  and  Resolution  process  area  (e.g., 
when  causal  analysis  and  resolution  is  used  organizationally  or  across 
multiple  projects). 

Example  Work  Products 

1 .  Updated  training  materials  (to  reflect  deployed  improvements) 

2.  Documented  results  of  improvement  deployment  activities 

3.  Revised  improvement  measures,  objectives,  priorities,  and  deployment 
plans 

Subpractices 

1 .  Monitor  the  deployment  of  improvements  using  deployment  plans. 

2.  Coordinate  the  deployment  of  improvements  across  the  organization. 

:  Coordinating  deployment  includes  the  following  activities: 

:  •  Coordinating  activities  of  projects,  support  groups,  and  organizational  groups  for 
i  each  improvement 

i_  •  Coordinating  activities  for  deploying  related  improvements 

3.  Deploy  improvements  in  a  controlled  and  disciplined  manner. 


230 


Organizational  Performance  Management  (OPM) 


CMMI  for  Acquisition,  Version  1.3 


Examples  of  methods  for  deploying  improvements  include  the  following: 

•  Deploying  improvements  incrementally  rather  than  as  a  single  deployment 

•  Providing  comprehensive  consulting  to  early  adopters  of  improvement  in  lieu  of 
revised  formal  training 


4.  Coordinate  the  deployment  of  improvements  into  the  projects’  defined 
processes  as  appropriate. 

Refer  to  the  Organizational  Process  Focus  process  area  for  more 
information  about  deploying  organizational  process  assets  and 
incorporating  experiences. 

5.  Provide  consulting  as  appropriate  to  support  deployment  of 
improvements. 

6.  Provide  updated  training  materials  or  develop  communication 
packages  to  reflect  improvements  to  organizational  process  assets. 

Refer  to  the  Organizational  Training  process  area  for  more  information 
about  providing  training. 

7.  Confirm  that  the  deployment  of  all  improvements  is  completed  in 
accordance  with  the  deployment  plan. 

8.  Document  and  review  results  of  improvement  deployment. 

i  Documenting  and  reviewing  results  includes  the  following: 

:  •  Identifying  and  documenting  lessons  learned 

:  •  Revising  improvement  measures,  objectives,  priorities,  and  deployment  plans 


SP  3.3  Evaluate  Improvement  Effects 

Evaluate  the  effects  of  deployed  improvements  on  quality  and 
process  performance  using  statistical  and  other  quantitative 
techniques. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  aligning  measurement  and  analysis  activities  and  providing 
measurement  results. 

This  specific  practice  can  overlap  with  the  Evaluate  the  Effect  of 
Implemented  Actions  specific  practice  in  the  Causal  Analysis  and 
Resolution  process  area  (e.g.,  when  causal  analysis  and  resolution  is 
applied  organizationally  or  across  multiple  projects). 

Example  Work  Products 

1 .  Documented  measures  of  the  effects  resulting  from  deployed 
improvements 

Subpractices 

1 .  Measure  the  results  of  each  improvement  as  implemented  on  the 
target  projects,  using  the  measures  defined  in  the  deployment  plans. 
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2.  Measure  and  analyze  progress  toward  achieving  the  organization’s 
quality  and  process  performance  objectives  using  statistical  and  other 
quantitative  techniques  and  take  corrective  action  as  needed. 

Refer  to  the  Organizational  Process  Performance  process  area  for 
more  information  about  establishing  quality  and  process  performance 
objectives  and  establishing  process  performance  baselines  and 
models. 
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ORGANIZATIONAL  PROCESS  PERFORMANCE 

A  Process  Management  Process  Area  at  Maturity  Level  4 


Purpose 


The  purpose  of  Organizational  Process  Performance  (OPP)  is  to  establish 
and  maintain  a  quantitative  understanding  of  the  performance  of  selected 
processes  in  the  organization’s  set  of  standard  processes  in  support  of 
achieving  quality  and  process  performance  objectives,  and  to  provide 
process  performance  data,  baselines,  and  models  to  quantitatively  manage 
the  organization’s  projects. 


Introductory  Notes 


The  Organizational  Process  Performance  process  area  involves  the 
following  activities: 

•  Establishing  organizational  quantitative  quality  and  process 
performance  objectives  based  on  business  objectives  (See  the 
definition  of  “quality  and  process  performance  objectives”  in  the 
glossary.) 

•  Selecting  processes  or  subprocesses  for  process  performance 
analyses 

•  Establishing  definitions  of  the  measures  to  be  used  in  process 
performance  analyses  (See  the  definition  of  “process 
performance”  in  the  glossary.) 

•  Establishing  process  performance  baselines  and  process 
performance  models  (See  the  definitions  of  “process  performance 
baselines”  and  “process  performance  models”  in  the  glossary.) 

The  collection  and  analysis  of  the  data  and  creation  of  the  process 
performance  baselines  and  models  can  be  performed  at  different  levels  of 
the  organization,  including  individual  projects  or  groups  of  related  projects 
as  appropriate  based  on  the  needs  of  the  projects  and  organization. 

The  common  measures  for  the  organization  consist  of  process  and  product 
measures  that  can  be  used  to  characterize  the  actual  performance  of 
processes  in  the  organization’s  individual  projects.  By  analyzing  the 
resulting  measurements,  a  distribution  or  range  of  results  can  be 
established  that  characterize  the  expected  performance  of  the  process 
when  used  on  an  individual  project. 

Measuring  quality  and  process  performance  can  involve  combining  existing 
measures  into  additional  derived  measures  to  provide  more  insight  into 
overall  efficiency  and  effectiveness  at  a  project  or  organization  level.  The 
analysis  at  the  organization  level  can  be  used  to  study  productivity,  improve 
efficiencies,  and  increase  throughput  across  projects  in  the  organization. 
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The  expected  process  performance  can  be  used  in  establishing  the 
project’s  quality  and  process  performance  objectives  and  can  be  used  as  a 
baseline  against  which  actual  project  performance  can  be  compared.  This 
information  is  used  to  quantitatively  manage  the  project.  Each  quantitatively 
managed  project,  in  turn,  provides  actual  performance  results  that  become 
a  part  of  organizational  process  assets  that  are  made  available  to  all 
projects. 

The  acquirer  can  use  quality  and  process  performance  objectives  to  define 
performance  and  service  level  expectations  for  suppliers. 

Process  performance  models  are  used  to  represent  past  and  current 
process  performance  and  to  predict  future  results  of  the  process.  For 
example,  the  latent  defects  in  the  delivered  product  can  be  predicted  using 
measurements  of  work  product  attributes  such  as  complexity  and  process 
attributes  such  as  preparation  time  for  peer  reviews. 

The  same  measures  of  latent  defects,  analyzed  using  a  supplier’s  past 
projects  data,  can  be  used  to  predict  the  quality  of  products  delivered  by 
that  supplier.  The  acquirer  can  use  supplier  process  performance  models  to 
predict  the  overall  capability  of  the  acquirer  to  deliver  the  product. 

When  the  organization  has  sufficient  measures,  data,  and  analytical 
techniques  for  critical  process,  product,  and  service  characteristics,  it  is 
able  to  do  the  following: 

•  Identify  aspects  of  processes  that  could  be  improved  across  acquirer- 
supplier  interfaces 

•  Determine  whether  processes  are  behaving  consistently  or  have  stable 
trends  (i.e.,  are  predictable) 

•  Identify  processes  in  which  performance  is  within  natural  bounds  that 
are  consistent  across  projects  and  could  potentially  be  aggregated 

•  Identify  processes  that  show  unusual  (e.g.,  sporadic,  unpredictable) 
behavior 

•  Identify  aspects  of  processes  that  can  be  improved  in  the  organization’s 
set  of  standard  processes 

•  Identify  the  implementation  of  a  process  that  performs  best 

This  process  area  interfaces  with  and  supports  the  implementation  of  other 
high  maturity  process  areas.  The  assets  established  and  maintained  as  part 
of  implementing  this  process  area  (e.g.,  the  measures  to  be  used  to 
characterize  subprocess  behavior,  process  performance  baselines,  process 
performance  models)  are  inputs  to  the  quantitative  project  management, 
causal  analysis  and  resolution,  and  organizational  performance 
management  processes  in  support  of  the  analyses  described  there. 
Quantitative  project  management  processes  provide  the  quality  and 
process  performance  data  needed  to  maintain  the  assets  described  in  this 
process  area. 
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Related  Process  Areas 


Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  specifying  measures,  obtaining  measurement  data,  and  analyzing 
measurement  data. 

Refer  to  the  Organizational  Performance  Management  process  area  for 
more  information  about  proactively  managing  the  organization’s 
performance  to  meet  its  business  objectives. 

Refer  to  the  Quantitative  Project  Management  process  area  for  more 
information  about  quantitatively  managing  the  project  to  achieve  the 
project’s  established  quality  and  process  performance  objectives. 

Specific  Goal  and  Practice  Summary 

SG  1  Establish  Performance  Baselines  and  Models 

SP  1 .1  Establish  Quality  and  Process  Performance  Objectives 

SP  1 .2  Select  Processes 

SP  1 .3  Establish  Process  Performance  Measures 

SP  1 .4  Analyze  Process  Performance  and  Establish  Process  Performance  Baselines 
SP  1.5  Establish  Process  Performance  Models 

Specific  Practices  by  Goal 


SG  1  Establish  Performance  Baselines  and  Models 

Baselines  and  models,  which  characterize  the  expected  process  performance 
of  the  organization’s  set  of  standard  processes,  are  established  and 
maintained. 

Prior  to  establishing  process  performance  baselines  and  models,  it  is 
necessary  to  determine  the  quality  and  process  performance  objectives  for 
those  processes  (the  Establish  Quality  and  Process  Performance 
Objectives  specific  practice),  which  processes  are  suitable  to  be  measured 
(the  Select  Processes  specific  practice),  and  which  measures  are  useful  for 
determining  process  performance  (the  Establish  Process  Performance 
Measures  specific  practice). 

The  first  three  practices  of  this  goal  are  interrelated  and  often  need  to  be 
performed  concurrently  and  iteratively  to  select  quality  and  process 
performance  objectives,  processes,  and  measures.  Often,  the  selection  of 
one  quality  and  process  performance  objective,  process,  or  measure  will 
constrain  the  selection  of  the  others.  For  example,  selecting  a  quality  and 
process  performance  objective  relating  to  defects  delivered  to  the  customer 
will  almost  certainly  require  selecting  the  verification  processes  and  defect 
related  measures. 

The  intent  of  this  goal  is  to  provide  projects  with  the  process  performance 
baselines  and  models  they  need  to  perform  quantitative  project 
management.  Many  times  these  baselines  and  models  are  collected  or 
created  by  the  organization,  but  there  are  circumstances  in  which  a  project 
may  need  to  create  the  baselines  and  models  for  themselves.  These 
circumstances  include  projects  that  are  not  covered  by  the  organization’s 
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baselines  and  models.  For  these  cases  the  project  follows  the  practices  in 
this  goal  to  create  its  baselines  and  models. 

SP  1.1  Establish  Quality  and  Process  Performance  Objectives 

Establish  and  maintain  the  organization’s  quantitative  objectives 
for  quality  and  process  performance,  which  are  traceable  to 
business  objectives. 

The  organization’s  quality  and  process  performance  objectives  can  be 
established  for  different  levels  in  the  organizational  structure  (e.g.,  business 
area,  product  line,  function,  project)  as  well  as  at  different  levels  in  the 
process  hierarchy.  When  establishing  quality  and  process  performance 
objectives,  consider  the  following: 

•  Traceability  to  the  organization’s  business  objectives 

•  Past  performance  of  the  selected  processes  or  subprocesses  in  context 
(e.g.,  on  projects) 

•  Multiple  attributes  of  process  performance  (e.g.,  product  quality, 
productivity,  cycle  time,  response  time) 

•  Inherent  variability  or  natural  bounds  of  the  selected  processes  or 
subprocesses 

The  organization’s  quality  and  process  performance  objectives  provide 
focus  and  direction  to  the  process  performance  analysis  and  quantitative 
project  management  activities.  However,  it  should  be  noted  that  achieving 
quality  and  process  performance  objectives  that  are  significantly  different 
from  current  process  capability  requires  use  of  techniques  found  in  Causal 
Analysis  and  Resolution  and  Organizational  Performance  Management. 

Example  Work  Products 

1 .  Organization’s  quality  and  process  performance  objectives 

Subpractices 

1 .  Review  the  organization’s  business  objectives  related  to  quality  and 
process  performance. 
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Examples  of  business  objectives  include  the  following: 

•  Deliver  products  within  budget  and  on  time 

•  Improve  product  quality  by  a  specified  percent  in  a  specified  timeframe 

•  Improve  productivity  by  a  specified  percent  in  a  specified  timeframe 

•  Maintain  customer  satisfaction  ratings 

•  Improve  time-to-market  for  new  product  or  service  releases  by  a  specified  percent 
in  a  specified  timeframe 

•  Reduce  deferred  product  functionality  by  a  specified  percent  in  a  specified 
timeframe 

•  Reduce  the  rate  of  product  recalls  by  a  specified  percent  in  a  specified  timeframe 

•  Reduce  customer  total  cost  of  ownership  by  a  specified  percent  in  a  specified 
timeframe 

•  Decrease  the  cost  of  maintaining  legacy  products  by  a  specified  percent  in  a 
specified  timeframe 


2.  Define  the  organization’s  quantitative  objectives  for  quality  and  process 
performance. 

Quality  and  process  performance  objectives  can  be  established  for  process  or 
subprocess  measurements  (e.g.,  effort,  cycle  time,  defect  removal  effectiveness)  as 
well  as  for  product  measurements  (e.g.,  reliability,  defect  density)  and  service 
measurements  (e.g.,  capacity,  response  times)  as  appropriate. 

:  Examples  of  quality  and  process  performance  objectives  include  the  following: 

i  •  Achieve  a  specified  defect  escape  rate,  productivity,  duration,  capacity,  or  cost 
j  target 

:  •  Improve  the  defect  escape  rate,  productivity,  duration,  capacity,  or  cost 
j  performance  by  a  specified  percent  of  the  process  performance  baseline  in  a 
j  specified  timeframe 

i  •  Improve  service  level  agreement  performance  by  a  specified  percent  of  the 

:  process  performance  baseline  in  a  specified  timeframe 


3.  Define  the  priorities  of  the  organization’s  objectives  for  quality  and 
process  performance. 

4.  Review,  negotiate,  and  obtain  commitment  to  the  organization’s  quality 
and  process  performance  objectives  and  their  priorities  from  relevant 
stakeholders. 

5.  Revise  the  organization’s  quantitative  objectives  for  quality  and 
process  performance  as  necessary. 

j  Examples  of  when  the  organization’s  quantitative  objectives  for  quality  and  process 
j  performance  may  need  to  be  revised  include  the  following: 

:  •  When  the  organization’s  business  objectives  change 

i  •  When  the  organization’s  set  of  standard  processes  change 

i  •  When  actual  quality  and  process  performance  differ  significantly  from  objectives 
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SP1.2  Select  Processes 

Select  processes  or  subprocesses  in  the  organization’s  set  of 
standard  processes  to  be  included  in  the  organization’s  process 
performance  analyses  and  maintain  traceability  to  business 
objectives. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

The  organization’s  set  of  standard  processes  consists  of  a  set  of  standard 
processes  that,  in  turn,  are  composed  of  subprocesses. 

Typically,  it  is  not  possible,  useful,  or  economically  justifiable  to  apply 
statistical  management  techniques  to  all  processes  or  subprocesses  of  the 
organization’s  set  of  standard  processes.  Selection  of  processes  or 
subprocesses  is  based  on  the  quality  and  process  performance  objectives 
of  the  organization,  which  are  derived  from  business  objectives  as 
described  in  the  previous  specific  practice. 

Example  Work  Products 

1 .  List  of  processes  or  subprocesses  identified  for  process  performance 
analyses  with  rationale  for  their  selection  including  traceability  to 
business  objectives 

Subpractices 

1 .  Establish  the  criteria  to  use  when  selecting  subprocesses. 

i  Examples  of  criteria  that  can  be  used  for  the  selection  of  a  process  or  subprocess  for 
:  the  organization’s  process  performance  analysis  include  the  following: 

i  •  The  process  or  subprocess  is  strongly  related  to  key  business  objectives, 
j  •  The  process  or  subprocess  has  demonstrated  stability  in  the  past. 

|  •  Valid  historical  data  are  currently  available  that  is  relevant  to  the  process  or 
subprocess. 

;  •  The  process  or  subprocess  will  generate  data  with  sufficient  frequency  to  allow  for 
i  statistical  management. 

:  •  The  process  or  subprocess  is  an  important  contributor  to  quality  and  process 
:  performance. 

:  •  The  process  or  subprocess  is  an  important  predictor  of  quality  and  process 
j  performance. 

j  •  The  process  or  subprocess  is  a  factor  important  to  understanding  the  risk 

|  associated  with  achieving  the  quality  and  process  performance  objectives. 

i  •  The  quality  of  the  measures  and  measurements  associated  with  the  process  or 

I  subprocess  (e.g.,  measurement  system  error)  is  adequate. 

i  •  Multiple  measurable  attributes  that  characterize  process  or  subprocess  behavior 
:  are  available. 


2.  Select  the  subprocesses  and  document  the  rationale  for  their  selection. 
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Example  approaches  to  identifying  and  evaluating  subprocess  alternatives  as  part  of  a 
selection  include  the  following: 

•  Causal  analysis 

•  Sensitivity  analysis 


Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal 
evaluation  process  that  evaluates  identified  alternatives  against 
established  criteria. 

3.  Establish  and  maintain  traceability  between  the  selected 

subprocesses,  quality  and  process  performance  objectives,  and 
business  objectives. 

:  Examples  of  ways  in  which  traceability  can  be  expressed  include  the  following: 

|  •  Mapping  of  subprocesses  to  quality  and  process  performance  objectives 
j  •  Objective  flow-down  (e.g.,  Big  Y  to  Vital  X,  Hoshin  planning) 

|  •  Balanced  scorecard 
:  •  Quality  Function  Deployment  (QFD) 
i  •  Goal  Question  Metric 

i  •  Documentation  for  a  process  performance  model 


4.  Revise  the  selection  as  necessary. 

It  may  be  necessary  to  revise  the  selection  in  the  following  situations: 

•  The  predictions  made  by  process  performance  models  result  in  too  much  variation 
to  make  them  useful. 

•  The  objectives  for  quality  and  process  performance  change. 

•  The  organization’s  set  of  standard  processes  change. 

•  The  underlying  quality  and  process  performance  changes. 

SP  1.3  Establish  Process  Performance  Measures 

Establish  and  maintain  definitions  of  measures  to  be  included  in 
the  organization’s  process  performance  analyses. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  specifying  measures. 

Example  Work  Products 

1 .  Definitions  of  selected  measures  of  process  performance  with  rationale 
for  their  selection  including  traceability  to  selected  processes  or 
subprocesses 

Subpractices 

1 .  Select  measures  that  reflect  appropriate  attributes  of  the  selected 
processes  or  subprocesses  to  provide  insight  into  the  organization’s 
quality  and  process  performance. 
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It  is  often  helpful  to  define  multiple  measures  for  a  process  or  subprocess  to 
understand  the  impact  of  changes  to  the  process  and  avoid  sub-optimization.  Also,  it  is 
often  helpful  to  establish  measures  for  both  product  and  process  attributes  for  the 
selected  process  and  subprocess,  as  well  as  its  inputs,  outputs,  and  resources 
(including  people  and  the  skill  they  bring)  consumed. 

The  Goal  Question  Metric  paradigm  is  an  approach  that  can  be  used  to  select 
measures  that  provide  insight  into  the  organization’s  quality  and  process  performance 
objectives.  It  is  often  useful  to  analyze  how  these  quality  and  process  performance 
objectives  can  be  achieved  based  on  an  understanding  of  process  performance 
provided  by  the  selected  measures. 

For  quality  and  process  performance  objectives  addressed  through  acquisition,  select 
process,  product,  and  service  level  measures  that  provide  insight  into  the  process 
performance  of  suppliers  and  into  the  quality  of  their  deliverables. 

Examples  of  criteria  used  to  select  measures  include  the  following: 

•  Relationship  of  measures  to  the  organization’s  quality  and  process  performance 
objectives 

•  Coverage  that  measures  provide  over  the  life  of  the  product  or  service 

•  Visibility  that  measures  provide  into  process  performance 

•  Availability  of  measures 

•  Frequency  at  which  observations  of  the  measure  can  be  collected 

•  Extent  to  which  measures  are  controllable  by  changes  to  the  process  or 
subprocess 

•  Extent  to  which  measures  represent  the  end  users’  view  of  effective  process 
performance 

•  Extent  to  which  measures  provide  insight  that  enables  the  acquirer  to  manage  the 
project 


2.  Establish  operational  definitions  for  the  selected  measures. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  specifying  measures. 

3.  Incorporate  selected  measures  into  the  organization’s  set  of  common 
measures. 

Measures  expected  to  be  collected  and  reported  by  suppliers  are  incorporated  into 
standard  supplier  agreement  templates  and  standard  service  level  agreements  as 
appropriate. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

4.  Revise  the  set  of  measures  as  necessary. 

Measures  are  periodically  evaluated  for  their  continued  usefulness  and  ability  to 
indicate  process  effectiveness. 
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SP  1.4  Analyze  Process  Performance  and  Establish  Process  Performance 
Baselines 

Analyze  the  performance  of  the  selected  processes,  and  establish 
and  maintain  the  process  performance  baselines. 

The  selected  measures  are  analyzed  to  characterize  the  performance  of  the 
selected  processes  or  subprocesses  achieved  on  projects.  This 
characterization  is  used  to  establish  and  maintain  process  performance 
baselines  (See  the  definition  of  “process  performance  baseline”  in  the 
glossary.)  These  baselines  are  used  to  determine  the  expected  results  of 
the  process  or  subprocess  when  used  on  a  project  under  a  given  set  of 
circumstances. 

Process  performance  baselines  are  compared  to  the  organization’s  quality 
and  process  performance  objectives  to  determine  if  the  quality  and  process 
performance  objectives  are  being  achieved. 

The  process  performance  baselines  are  a  measurement  of  performance  for 
the  organization’s  set  of  standard  processes  at  various  levels  of  detail.  The 
processes  that  the  process  performance  baselines  can  address  include  the 
following: 

•  Sequence  of  connected  processes 

•  Processes  that  cover  the  entire  life  of  the  project 

•  Processes  for  developing  individual  work  products 

There  can  be  several  process  performance  baselines  to  characterize 
performance  for  subgroups  of  the  organization. 

j  Examples  of  criteria  used  to  categorize  subgroups  include  the  following: 

i  •  Supplier-acquisition  approach 
j  •  Agreement  type  (e.g.,  fixed  price,  time  and  effort) 

|  •  Product  line  or  standard  service 
:  •  Line  of  business 

:  •  Application  domain 

:  •  Complexity 

i  •  Team  size 

j  •  Work  product  size 

|  •  Process  elements  from  the  organization’s  set  of  standard  processes 


Tailoring  the  organization’s  set  of  standard  processes  can  significantly 
affect  the  comparability  of  data  for  inclusion  in  process  performance 
baselines.  Effects  of  tailoring  should  be  considered  in  establishing 
baselines.  Depending  on  the  tailoring  allowed,  separate  performance 
baselines  may  exist  for  each  type  of  tailoring. 

Refer  to  the  Quantitative  Project  Management  process  area  for  more 
information  about  quantitatively  managing  the  project  to  achieve  the 
project’s  established  quality  and  process  performance  objectives. 
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Example  Work  Products 

1 .  Analysis  of  process  performance  data 

2.  Baseline  data  on  the  organization’s  process  performance 

Subpractices 

1 .  Collect  the  selected  measurements  for  the  selected  processes  and 
subprocesses. 

The  process  or  subprocess  in  use  when  the  measurement  was  taken  is  recorded  to 
enable  its  use  later. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  specifying  measurement  data  collection  and  storage 
procedures. 

2.  Analyze  the  collected  measures  to  establish  a  distribution  or  range  of 
results  that  characterize  the  expected  performance  of  selected 
processes  or  subprocesses  when  used  on  a  project. 

This  analysis  should  include  the  stability  of  the  related  process  or  subprocess,  and  the 
impacts  of  associated  factors  and  context.  Related  factors  include  inputs  to  the 
process  and  other  attributes  that  can  affect  the  results  obtained.  The  context  includes 
the  business  context  (e.g.,  domain)  and  significant  tailoring  of  the  organization’s  set  of 
standard  processes. 

The  measurements  from  stable  subprocesses  in  projects  should  be  used  when 
possible;  other  data  may  not  be  reliable. 

3.  Establish  and  maintain  the  process  performance  baselines  from 
collected  measurements  and  analyses. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  aligning  measurement  and  analysis  activities  and 
providing  measurement  results. 

Process  performance  baselines  are  derived  by  analyzing  collected  measures  to 
establish  a  distribution  or  range  of  results  that  characterize  the  expected  performance 
for  selected  processes  or  subprocesses  when  used  on  a  project  in  the  organization. 

4.  Review  and  get  agreement  with  relevant  stakeholders  about  the 
process  performance  baselines. 

5.  Make  the  process  performance  information  available  across  the 
organization  in  the  measurement  repository. 

The  organization’s  process  performance  baselines  are  used  by  projects  to  estimate 
the  natural  bounds  for  process  performance. 

6.  Compare  the  process  performance  baselines  to  associated  quality  and 
process  performance  objectives  to  determine  if  those  quality  and 
process  performance  objectives  are  being  achieved. 

These  comparisons  should  use  statistical  techniques  beyond  a  simple  comparison  of 
the  mean  to  gauge  the  extent  of  quality  and  process  performance  objective 
achievement.  If  the  quality  and  process  performance  objectives  are  not  being 
achieved,  corrective  actions  should  be  considered. 
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Refer  to  the  Causal  Analysis  and  Resolution  process  area  for  more 
information  about  determining  causes  of  selected  outcomes. 

Refer  to  the  Organizational  Process  Focus  process  area  for  more 
information  about  planning  and  implementing  process  actions. 

Refer  to  the  Organizational  Performance  Management  for  more 
information  about  analyzing  process  performance  data  and  identifying 
potential  areas  for  improvement. 

7.  Revise  the  process  performance  baselines  as  necessary. 

j  Examples  of  when  the  organization’s  process  performance  baselines  may  need  to  be 
j  revised  include  the  following: 

:  •  When  processes  change 
i  •  When  the  organization’s  results  change 
:  •  When  the  organization’s  needs  change 
:  •  When  suppliers’  processes  change 
:  •  When  suppliers  change 


SP  1.5  Establish  Process  Performance  Models 

Establish  and  maintain  process  performance  models  for  the 
organization’s  set  of  standard  processes. 

High  maturity  organizations  generally  establish  and  maintain  a  set  of 
process  performance  models  at  various  levels  of  detail  that  cover  a  range  of 
activities  that  are  common  across  the  organization  and  address  the 
organization’s  quality  and  process  performance  objectives.  (See  the 
definition  of  “process  performance  model”  in  the  glossary.)  Under  some 
circumstances,  projects  may  need  to  create  their  own  process  performance 
models. 

Process  performance  models  are  used  to  estimate  or  predict  the  value  of  a 
process  performance  measure  from  the  values  of  other  process,  product, 
and  service  measurements.  These  process  performance  models  typically 
use  process  and  product  measurements  collected  throughout  the  life  of  the 
project  to  estimate  progress  toward  achieving  quality  and  process 
performance  objectives  that  cannot  be  measured  until  later  in  the  project’s 
life. 

Process  performance  models  are  used  to  estimate  or  predict  when  to  fund, 
hold,  cancel,  migrate,  re-engineer,  or  retire  a  project.  Process  performance 
models  allow  the  acquirer  to  synchronize  processes  with  customer  needs. 
The  organization’s  process  performance  baselines  provide  quantitative  data 
on  those  aspects  of  the  projects  and  organization  that  can  approximate  the 
throughput  potential  of  its  processes.  Focusing  on  these  critical  constraints, 
process  performance  models  allow  the  acquirer  to  predict  how  to  best 
maximize  the  flow  of  work  through  projects  and  the  organization. 

Process  performance  models  are  used  as  follows: 
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•  The  organization  uses  them  for  estimating,  analyzing,  and  predicting 
the  process  performance  associated  with  processes  in  and  changes  to 
the  organization’s  set  of  standard  processes. 

•  The  organization  uses  them  to  assess  the  (potential)  return  on 
investment  for  process  improvement  activities. 

•  Projects  use  them  for  estimating,  analyzing,  and  predicting  the  process 
performance  of  their  defined  processes. 

•  Projects  use  them  for  selecting  processes  or  subprocesses  for  use. 

•  Projects  use  them  for  estimating  progress  toward  achieving  the 
project’s  quality  and  process  performance  objectives. 

Process  performance  models  are  also  used  to  set  quality  and  process 
performance  objectives  for  suppliers  and  to  provide  data  that  can  help 
suppliers  achieve  these  objectives. 

These  measures  and  models  are  defined  to  provide  insight  into  and  to 
provide  the  ability  to  predict  critical  process  and  product  characteristics  that 
are  relevant  to  the  organization’s  quality  and  process  performance 
objectives. 

Results  of  the  acquirer’s  process  performance  models  are  shared  with 
suppliers  to  help  ensure  the  synchronized  delivery  of  products  and  services. 

Examples  of  process  performance  models  include  the  following: 

•  System  dynamics  models 

•  Regression  models 

•  Complexity  models 

•  Supply  chain  models 

•  Discrete  event  simulation  models 

•  Monte  Carlo  simulation  models 


Refer  to  the  Quantitative  Project  Management  process  area  for  more 

information  about  quantitatively  managing  the  project  to  achieve  the 

project’s  established  quality  and  process  performance  objectives. 

Example  Work  Products 

1 .  Process  performance  models 

Example  Supplier  Deliverables 

1 .  Supplier  process  performance  models 

Subpractices 

1 .  Establish  process  performance  models  based  on  the  organization’s  set 
of  standard  processes  and  process  performance  baselines. 

2.  Calibrate  process  performance  models  based  on  the  past  results  and 
current  needs. 

3.  Review  process  performance  models  and  get  agreement  with  relevant 
stakeholders. 
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4.  Support  the  projects’  use  of  process  performance  models. 

5.  Revise  process  performance  models  as  necessary. 

;  Examples  of  when  process  performance  models  may  need  to  be  revised  include  the 
:  following: 

|  •  When  supplier  processes  that  directly  interface  with  acquirer  processes  change 
|  •  When  suppliers  change 
:  •  When  processes  change 
i  •  When  the  organization’s  results  change 

i  •  When  the  organization’s  quality  and  process  performance  objectives  change 
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ORGANIZATIONAL  TRAINING 


A  Process  Management  Process  Area  at  Maturity  Level  3 


Purpose 


The  purpose  of  Organizational  Training  (OT)  is  to  develop  skills  and 
knowledge  of  people  so  they  can  perform  their  roles  effectively  and 
efficiently. 


Introductory  Notes 


Organizational  Training  addresses  training  provided  to  support  the 
organization’s  strategic  business  objectives  and  to  meet  the  tactical  training 
needs  that  are  common  across  projects  and  support  groups.  Training  needs 
identified  by  individual  projects  and  support  groups  to  meet  their  specific 
needs  are  handled  at  the  project  and  support  group  level  and  are  outside 
the  scope  of  the  Organizational  Training  process  area. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
planning  needed  knowledge  and  skills. 

An  organizational  training  program  involves  the  following  activities: 

•  Identifying  the  training  needed  by  the  organization 

•  Obtaining  and  providing  training  to  address  those  needs 

•  Establishing  and  maintaining  a  training  capability 

•  Establishing  and  maintaining  training  records 

•  Assessing  training  effectiveness 

Effective  training  requires  the  assessment  of  needs,  planning,  instructional 
design,  and  appropriate  training  media  (e.g.,  workbooks,  computer 
software),  as  well  as  a  repository  of  training  process  data.  As  an 
organizational  process,  the  main  components  of  training  include  a  managed 
training  development  program,  documented  plans,  staff  with  an  appropriate 
mastery  of  disciplines  and  other  areas  of  knowledge,  and  mechanisms  for 
measuring  the  effectiveness  of  the  training  program. 

Identifying  process  training  needs  is  based  primarily  on  the  skills  required  to 
perform  the  organization’s  set  of  standard  processes. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  standard  processes. 

Certain  skills  can  be  effectively  and  efficiently  imparted  through  vehicles 
other  than  classroom  training  experiences  (e.g.,  informal  mentoring).  Other 
skills  require  more  formalized  training  vehicles,  such  as  in  a  classroom,  by 
web-based  training,  through  guided  self  study,  or  via  a  formalized  on-the- 
job  training  program.  The  formal  or  informal  training  vehicles  employed  for 
each  situation  should  be  based  on  an  assessment  of  the  need  for  training 


Organizational  Training  (OT) 


247 


CMMI  for  Acquisition,  Version  1.3 


and  the  performance  gap  to  be  addressed.  The  term  “training”  used 
throughout  this  process  area  is  used  broadly  to  include  all  of  these  learning 
options. 

Success  in  training  is  indicated  by  the  availability  of  opportunities  to  acquire 
the  skills  and  knowledge  needed  to  perform  new  and  ongoing  enterprise 
activities. 

Skills  and  knowledge  can  be  technical,  organizational,  or  contextual. 
Technical  skills  pertain  to  the  ability  to  use  equipment,  tools,  materials, 
data,  and  processes  required  by  a  project  or  process.  Organizational  skills 
pertain  to  behavior  within  and  according  to  the  staff  members’  organization 
structure,  role  and  responsibilities,  and  general  operating  principles  and 
methods.  Contextual  skills  are  the  self-management,  communication,  and 
interpersonal  abilities  needed  to  successfully  perform  work  in  the 
organizational  and  social  context  of  the  project  and  support  groups. 

This  process  area  applies  to  developing  acquirer  skills  and  knowledge  so 
that  those  acquirers  in  the  organization  can  perform  their  roles  effectively 
and  efficiently.  However,  these  practices  can  also  apply  to  developing  the 
supplier  skills  and  knowledge.  Topics  can  include  acquirer  business 
practices  (e.g.,  acceptance,  invoicing)  as  well  as  practices  that  the  acquirer 
desires  to  be  performed  in  a  particular  way  (e.g.,  reflect  lean  thinking)  or  a 
collaborative  way  (e.g.,  using  an  Agile  approach). 


Related  Process  Areas 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal  evaluation 
process  that  evaluates  identified  alternatives  against  established  criteria. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
planning  needed  knowledge  and  skills. 

Specific  Goal  and  Practice  Summary 

SG  1  Establish  an  Organizational  Training  Capability 
SP  1.1  Establish  Strategic  Training  Needs 

SP  1 .2  Determine  Which  Training  Needs  Are  the  Responsibility  of  the  Organization 

SP  1.3  Establish  an  Organizational  Training  Tactical  Plan 
SP  1 .4  Establish  a  Training  Capability 

SG  2  Provide  Training 

SP2.1  Deliver  Training 

SP  2.2  Establish  Training  Records 

SP  2.3  Assess  Training  Effectiveness 
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Specific  Practices  by  Goal 


SG  1  Establish  an  Organizational  Training  Capability 

A  training  capability,  which  supports  the  roles  in  the  organization,  is 
established  and  maintained. 

The  organization  identifies  training  required  to  develop  the  skills  and 
knowledge  necessary  to  perform  enterprise  activities.  Once  the  needs  are 
identified,  a  training  program  addressing  those  needs  is  developed. 

SP  1.1  Establish  Strategic  Training  Needs 

Establish  and  maintain  strategic  training  needs  of  the  organization. 

Strategic  training  needs  address  long-term  objectives  to  build  a  capability 
by  filling  significant  knowledge  gaps,  introducing  new  technologies,  or 
implementing  major  changes  in  behavior.  Strategic  planning  typically  looks 
two  to  five  years  into  the  future. 

r - - 

|  Examples  of  sources  of  strategic  training  needs  include  the  following: 

|  •  The  organization’s  standard  processes 
:  •  The  organization’s  strategic  business  plan 
i  •  The  organization’s  process  improvement  plan 
i  •  Enterprise  level  initiatives 

i  •  Skill  assessments 

i  •  Risk  analyses 

|  •  Acquisition  and  supplier  management 


Example  Work  Products 

1.  Training  needs 

2.  Assessment  analysis 

Subpractices 

1 .  Analyze  the  organization’s  strategic  business  objectives  and  process 
improvement  plan  to  identify  potential  training  needs. 

2.  Document  the  strategic  training  needs  of  the  organization. 
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Examples  of  categories  of  training  needs  include  the  following: 

•  Process  analysis  and  documentation 

•  Engineering  (e.g.,  requirements  analysis,  design,  testing,  configuration 
management,  quality  assurance) 

•  Selection  and  management  of  suppliers 

•  Team  building 

•  Management  (e.g.,  estimating,  tracking,  risk  management) 

•  Leadership 

•  Disaster  recovery  and  continuity  of  operations 

•  Acquisition  management  (e.g.,  solicitation,  supplier  selection,  supplier 
management) 

•  Communication  and  negotiation  skills 


3.  Determine  the  roles  and  skills  needed  to  perform  the  organization’s  set 
of  standard  processes. 

i  Roles  typically  include  project  manager,  architects,  business  process  analysts  and 
i  suppliers,  especially  in  process  elements  that  identify  interfaces  with  and  expectations 
i_  from  suppliers. 

4.  Document  the  training  needed  to  perform  roles  in  the  organization’s  set 
of  standard  processes. 

5.  Document  the  training  needed  to  maintain  the  safe,  secure,  and 
continued  operation  of  the  business. 

6.  Revise  the  organization’s  strategic  needs  and  required  training  as 
necessary. 

SP  1.2  Determine  Which  Training  Needs  Are  the  Responsibility  of  the 
Organization 

Determine  which  training  needs  are  the  responsibility  of  the 
organization  and  which  are  left  to  the  individual  project  or  support 
group. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
planning  needed  knowledge  and  skills. 

In  addition  to  strategic  training  needs,  organizational  training  addresses 
training  requirements  that  are  common  across  projects  and  support  groups. 
Projects  and  support  groups  have  the  primary  responsibility  for  identifying 
and  addressing  their  training  needs.  The  organization’s  training  staff  is 
responsible  for  addressing  only  common  cross-project  and  support  group 
training  needs  (e.g.,  training  in  work  environments  common  to  multiple 
projects).  In  some  cases,  however,  the  organization’s  training  staff  may 
address  additional  training  needs  of  projects  and  support  groups,  as 
negotiated  with  them,  in  the  context  of  the  training  resources  available  and 
the  organization’s  training  priorities. 


250 


Organizational  Training  (OT) 


CMMI  for  Acquisition,  Version  1.3 


Example  Work  Products 

1 .  Common  project  and  support  group  training  needs 

2.  Training  commitments 

Subpractices 

1 .  Analyze  the  training  needs  identified  by  projects  and  support  groups. 

Analysis  of  project  and  support  group  needs  is  intended  to  identify  common  training 
needs  that  can  be  most  efficiently  addressed  organization  wide.  These  needs  analysis 
activities  are  used  to  anticipate  future  training  needs  that  are  first  visible  at  the  project 
and  support  group  level. 

2.  Negotiate  with  projects  and  support  groups  on  how  their  training  needs 
will  be  satisfied. 

The  support  provided  by  the  organization’s  training  staff  depends  on  the  training 
resources  available  and  the  organization’s  training  priorities. 

i  Examples  of  training  appropriately  performed  by  the  project  or  support  group  include 
i  the  following: 

:  •  Training  in  the  application  or  service  domain  of  the  project 
:  •  Training  in  the  unique  tools  and  methods  used  by  the  project  or  support  group 
j  •  Training  in  safety,  security,  and  human  factors 

3.  Document  commitments  for  providing  training  support  to  projects  and 
support  groups. 

SP  1.3  Establish  an  Organizational  Training  Tactical  Plan 

Establish  and  maintain  an  organizational  training  tactical  plan. 

The  organizational  training  tactical  plan  is  the  plan  to  deliver  the  training 
that  is  the  responsibility  of  the  organization  and  is  necessary  for  individuals 
to  perform  their  roles  effectively.  This  plan  addresses  the  near-term 
execution  of  training  and  is  adjusted  periodically  in  response  to  changes 
(e.g.,  in  needs,  in  resources)  and  to  evaluations  of  effectiveness. 

Example  Work  Products 

1 .  Organizational  training  tactical  plan 

Subpractices 

1.  Establish  the  content  of  the  plan. 
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Organizational  training  tactical  plans  typically  contain  the  following: 

•  Training  needs 

•  Training  topics 

•  Schedules  based  on  training  activities  and  their  dependencies 

•  Methods  used  for  training 

•  Requirements  and  quality  standards  for  training  materials 

•  Training  tasks,  roles,  and  responsibilities 

•  Required  resources  including  tools,  facilities,  environments,  staffing,  skills,  and 
knowledge 


2.  Establish  commitments  to  the  plan. 

Documented  commitments  by  those  who  are  responsible  for  implementing  and 
supporting  the  plan  are  essential  for  the  plan  to  be  effective. 

3.  Revise  the  plan  and  commitments  as  necessary. 

SP  1.4  Establish  a  Training  Capability 

Establish  and  maintain  a  training  capability  to  address 
organizational  training  needs. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal  evaluation 
process  that  evaluates  identified  alternatives  against  established  criteria. 

Example  Work  Products 

1 .  Training  materials  and  supporting  artifacts 

Subpractices 

1 .  Select  appropriate  approaches  to  satisfy  organizational  training  needs. 

Many  factors  may  affect  the  selection  of  training  approaches,  including  audience 
specific  knowledge,  costs,  schedule,  and  the  work  environment.  Selecting  an  approach 
requires  consideration  of  the  means  to  provide  skills  and  knowledge  in  the  most 
effective  way  possible  given  the  constraints. 

j  Examples  of  training  approaches  include  the  following: 

|  •  Classroom  training 
:  •  Computer  aided  instruction 
i  •  Guided  self  study 

i  •  Formal  apprenticeship  and  mentoring  programs 
:  •  Facilitated  videos 
:  •  Chalk  talks 
:  •  Brown  bag  lunch  seminars 
|  •  Structured  on-the-job  training 

2.  Determine  whether  to  develop  training  materials  internally  or  to  acquire 
them  externally. 
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Determine  the  costs  and  benefits  of  internal  training  development  and  of  acquiring 
training  externally, 

:  Example  criteria  that  can  be  used  to  determine  the  most  effective  mode  of  knowledge 
i  or  skill  acquisition  include  the  following: 

:  •  Applicability  to  work  or  process  performance  objectives 
:  •  Availability  of  time  to  prepare  for  project  execution 
:  •  Applicability  to  business  objectives 
:  •  Availability  of  in-house  expertise 
j_  •  Availability  of  training  from  external  sources 

j  Examples  of  external  sources  of  training  include  the  following: 
j  •  Customer  provided  training 
i  •  Commercially  available  training  courses 
i  •  Academic  programs 
;  •  Professional  conferences 
:  •  Seminars 


3.  Develop  or  obtain  training  materials. 

Training  can  be  provided  by  the  project,  support  groups,  the  organization,  or  an 
external  organization.  The  organization’s  training  staff  coordinates  the  acquisition  and 
delivery  of  training  regardless  of  its  source, 

j  Examples  of  training  materials  include  the  following: 
i  •  Courses 

:  •  Computer-aided  instruction 
:  •  Videos 

4.  Develop  or  obtain  qualified  instructors,  instructional  designers,  or 
mentors. 

To  ensure  that  those  who  develop  and  deliver  internal  training  have  the  necessary 
knowledge  and  training  skills,  criteria  can  be  defined  to  identify,  develop,  and  qualify 
them.  The  development  of  training,  including  self  study  and  online  training,  should 
involve  those  who  have  experience  in  instructional  design.  In  the  case  of  external 
training,  the  organization’s  training  staff  can  investigate  how  the  training  provider 
determines  which  instructors  will  deliver  the  training.  This  selection  of  qualified 
instructors  can  also  be  a  factor  in  selecting  or  continuing  to  use  a  training  provider. 

5.  Describe  the  training  in  the  organization’s  training  curriculum. 
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Examples  of  the  information  provided  in  training  descriptions  for  each  course  include 
the  following: 

•  Topics  covered  in  the  training 

•  Intended  audience 

•  Prerequisites  and  preparation  for  participating 

•  Training  objectives 

•  Length  of  the  training 

•  Lesson  plans 

•  Completion  criteria  for  the  course 

•  Criteria  for  granting  training  waivers 


6.  Revise  training  materials  and  supporting  artifacts  as  necessary. 

:  Examples  of  situations  in  which  training  materials  and  supporting  artifacts  may  need  to 
i  be  revised  include  the  following: 

j  •  Training  needs  change  (e.g.,  when  new  technology  associated  with  the  training 
topic  is  available) 

:  •  An  evaluation  of  the  training  identifies  the  need  for  change  (e.g.,  evaluations  of 
:  training  effectiveness  surveys,  training  program  performance  assessments, 

:  instructor  evaluation  forms) 


SG  2  Provide  Training 

Training  for  individuals  to  perform  their  roles  effectively  is  provided. 

When  selecting  people  to  be  trained,  the  following  should  be  considered: 

•  Background  of  the  target  population  of  training  participants 

•  Prerequisite  background  to  receive  training 

•  Skills  and  abilities  needed  by  people  to  perform  their  roles 

•  Need  for  cross-discipline  training  for  all  disciplines,  including  project 
management 

•  Need  for  managers  to  have  training  in  appropriate  organizational 
processes 

•  Need  for  training  in  basic  principles  of  all  appropriate  disciplines  or 
services  to  support  staff  in  quality  management,  configuration 
management,  and  other  related  support  functions 

•  Need  to  provide  competency  development  for  critical  functional  areas 

•  Need  to  maintain  competencies  and  qualifications  of  staff  to  operate 
and  maintain  work  environments  common  to  multiple  projects 

SP  2.1  Deliver  Training 

Deliver  training  following  the  organizational  training  tactical  plan. 

Example  Work  Products 

1 .  Delivered  training  course 
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Subpractices 

1 .  Select  those  who  will  receive  the  training  necessary  to  perform  their 
roles  effectively. 

The  acquirer  includes  supplier  representatives,  as  appropriate,  to  ensure  selected 
suppliers  can  effectively  interface  with  acquirer  processes. 

Training  is  intended  to  impart  knowledge  and  skills  to  people  performing  various  roles 
in  the  organization.  Some  people  already  possess  the  knowledge  and  skills  required  to 
perform  well  in  their  designated  roles.  Training  can  be  waived  for  these  people,  but 
care  should  be  taken  that  training  waivers  are  not  abused. 

2.  Schedule  the  training,  including  any  resources,  as  necessary  (e.g., 
facilities,  instructors). 

Training  should  be  planned  and  scheduled.  Training  is  provided  that  has  a  direct 
bearing  on  work  performance  expectations.  Therefore,  optimal  training  occurs  in  a 
timely  manner  with  regard  to  imminent  job  performance  expectations. 

■  These  performance  expectations  often  include  the  following: 
j  •  Training  in  the  use  of  specialized  tools 

i  •  Training  in  procedures  that  are  new  to  the  person  who  will  perform  them 

3.  Deliver  the  training. 

If  the  training  is  delivered  by  a  person,  then  appropriate  training  professionals  (e.g., 
experienced  instructors,  mentors)  should  deliver  the  training.  When  possible,  training 
is  delivered  in  settings  that  closely  resemble  the  actual  work  environment  and  includes 
activities  to  simulate  actual  work  situations.  This  approach  includes  integration  of  tools, 
methods,  and  procedures  for  competency  development.  Training  is  tied  to  work 
responsibilities  so  that  on-the-job  activities  or  other  outside  experiences  will  reinforce 
the  training  within  a  reasonable  time  after  the  training  was  delivered. 

4.  Track  the  delivery  of  training  against  the  plan. 

SP  2.2  Establish  Training  Records 

Establish  and  maintain  records  of  organizational  training. 

This  practice  applies  to  the  training  performed  at  the  organizational  level. 
Establishment  and  maintenance  of  training  records  for  project  or  support 
group  sponsored  training  is  the  responsibility  of  each  individual  project  or 
support  group. 

Example  Work  Products 

1.  Training  records 

2.  Training  updates  to  the  organizational  repository 

Example  Supplier  Deliverables 

1 .  Training  records  as  appropriate 
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Subpractices 

1 .  Keep  records  of  all  students  who  successfully  complete  each  training 
course  or  other  approved  training  activity  as  well  as  those  who  are 
unsuccessful. 

2.  Keep  records  of  all  staff  who  are  waived  from  training. 

The  rationale  for  granting  a  waiver  should  be  documented,  and  both  the  manager 
responsible  and  the  manager  of  the  excepted  individual  should  approve  the  waiver. 

3.  Keep  records  of  all  students  who  successfully  complete  their  required 
training. 

4.  Make  training  records  available  to  the  appropriate  people  for 
consideration  in  assignments. 

Training  records  may  be  part  of  a  skills  matrix  developed  by  the  training  organization 
to  provide  a  summary  of  the  experience  and  education  of  people,  as  well  as  training 
sponsored  by  the  organization. 

SP  2.3  Assess  Training  Effectiveness 

Assess  the  effectiveness  of  the  organization’s  training  program. 

A  process  should  exist  to  determine  the  effectiveness  of  training  (i.e.,  how 
well  training  is  meeting  the  organization’s  needs). 

r - - 

I  Examples  of  methods  used  to  assess  training  effectiveness  include  the  following: 

|  •  Testing  in  the  training  context 
:  •  Post-training  surveys  of  training  participants 
i  •  Surveys  of  manager  satisfaction  with  post-training  effects 
i  •  Assessment  mechanisms  embedded  in  courseware 


Measures  can  be  taken  to  assess  the  benefits  of  training  against  both  the 
project’s  and  organization’s  objectives.  Particular  attention  should  be  paid 
to  the  need  for  various  training  methods,  such  as  training  teams  as  integral 
work  units.  When  used,  work  or  process  performance  objectives  should  be 
unambiguous,  observable,  verifiable,  and  shared  with  course  participants. 
The  results  of  the  training  effectiveness  assessment  should  be  used  to 
revise  training  materials  as  described  in  the  Establish  a  Training  Capability 
specific  practice. 

Example  Work  Products 

1 .  Training  effectiveness  surveys 

2.  Training  program  performance  assessments 

3.  Instructor  evaluation  forms 

4.  Training  examinations 

Subpractices 

1 .  Assess  in-progress  or  completed  projects  to  determine  whether  staff 
knowledge  is  adequate  for  performing  project  tasks. 
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2.  Provide  a  mechanism  for  assessing  the  effectiveness  of  each  training 
course  with  respect  to  established  organizational,  project,  or  individual 
learning  (or  performance)  objectives. 

3.  Obtain  student  evaluations  of  how  well  training  activities  met  their 
needs. 
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PROJECT  MONITORING  AND  CONTROL 

A  Project  Management  Process  Area  at  Maturity  Level  2 


Purpose 


The  purpose  of  Project  Monitoring  and  Control  (PMC)  is  to  provide  an 
understanding  of  the  project’s  progress  so  that  appropriate  corrective 
actions  can  be  taken  when  the  project’s  performance  deviates  significantly 
from  the  plan. 


Introductory  Notes 


A  project’s  documented  plan  is  the  basis  for  monitoring  activities, 
communicating  status,  and  taking  corrective  action.  Progress  is  primarily 
determined  by  comparing  actual  work  product  and  task  attributes,  effort, 
cost,  and  schedule  to  the  plan  at  prescribed  milestones  or  control  levels  in 
the  project  schedule  or  WBS.  Appropriate  visibility  of  progress  enables 
timely  corrective  action  to  be  taken  when  performance  deviates  significantly 
from  the  plan.  A  deviation  is  significant  if,  when  left  unresolved,  it  precludes 
the  project  from  meeting  its  objectives. 

The  term  “project  plan”  is  used  throughout  this  process  area  to  refer  to  the 
overall  plan  for  controlling  the  project. 

Monitoring  and  control  functions  are  established  early  in  the  project  as  the 
project’s  planning  is  performed  and  the  acquisition  strategy  is  defined.  As 
the  acquisition  of  technology  solutions  unfolds,  monitoring  and  control 
activities  are  essential  to  ensure  that  appropriate  resources  are  being 
applied  and  that  acquirer  activities  are  progressing  according  to  plan. 

When  actual  status  deviates  significantly  from  expected  values,  corrective 
actions  are  taken  as  appropriate.  These  actions  can  require  replanning, 
which  can  include  revising  the  original  plan,  establishing  new  agreements, 
or  including  additional  mitigation  activities  in  the  current  plan. 

If  corrective  action  is  required  to  resolve  variances  from  project  plans,  these 
actions  should  be  defined  and  tracked  to  closure. 

After  one  or  more  suppliers  are  selected  and  agreements  are  established, 
the  role  of  monitoring  and  control  becomes  twofold:  (1)  the  acquirer 
continues  to  monitor  and  control  its  activities  and  work  products  while  also 
(2)  monitoring  and  controlling  supplier  project  progress  and  performance  for 
impacts  to  the  overall  project  plan. 

The  supplier  project  progress  and  performance  reporting  requirements  are 
established  in  the  supplier  agreement  consistent  with  the  needs  of  the 
project. 
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Related  Process  Areas 

Refer  to  the  Agreement  Management  process  area  for  more  information 
about  ensuring  that  the  supplier  and  the  acquirer  perform  according  to  the 
terms  of  the  supplier  agreement. 

Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  supplier  agreements. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  providing  measurement  results. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
establishing  and  maintaining  plans  that  define  project  activities. 

Specific  Goal  and  Practice  Summary 

SG  1  Monitor  the  Project  Against  the  Plan 

SP  1.1  Monitor  Project  Planning  Parameters 

SP  1 .2  Monitor  Commitments 

SP  1 .3  Monitor  Project  Risks 

SP  1 .4  Monitor  Data  Management 

SP  1 .5  Monitor  Stakeholder  Involvement 

SP  1 .6  Conduct  Progress  Reviews 

SP  1 .7  Conduct  Milestone  Reviews 

SP  1 .8  Monitor  Transition  to  Operations  and  Support 

SG  2  Manage  Corrective  Action  to  Closure 
SP  2.1  Analyze  Issues 

SP  2.2  Take  Corrective  Action 

SP  2.3  Manage  Corrective  Actions 

Specific  Practices  by  Goal 


SG  1  Monitor  the  Project  Against  the  Plan 

Actual  project  progress  and  performance  are  monitored  against  the  project 
plan. 

Monitoring  acquirer  project  progress  and  performance  begins  as  soon  as  a 
plan  is  established.  The  acquirer  is  responsible  for  monitoring  the  progress 
and  output  of  the  project.  After  a  supplier  is  selected  and  a  supplier 
agreement  put  in  place,  the  acquirer’s  monitoring  and  control  activities 
extend  to  the  supplier  and  its  activities.  The  acquirer  monitors  supplier 
progress,  including  achievement  of  requirements  established  in  the  supplier 
agreement  and  using  specified  process,  product,  and  service  level 
measures. 

SP  1.1  Monitor  Project  Planning  Parameters 

Monitor  actual  values  of  project  planning  parameters  against  the 
project  plan. 

Project  planning  parameters  constitute  typical  indicators  of  project  progress 
and  performance  and  include  attributes  of  work  products  and  tasks,  costs, 
effort,  and  schedule.  Attributes  of  the  work  products  and  tasks  include  size, 
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complexity,  service  level,  availability,  weight,  form,  fit,  and  function.  The 
frequency  of  monitoring  parameters  should  be  considered. 

Monitoring  typically  involves  measuring  actual  values  of  project  planning 
parameters,  comparing  actual  values  to  estimates  in  the  plan,  and 
identifying  significant  deviations.  Recording  actual  values  of  project 
planning  parameters  includes  recording  associated  contextual  information 
to  help  understand  measures.  An  analysis  of  the  impact  that  significant 
deviations  have  on  determining  the  corrective  actions  to  take  is  handled  in 
specific  goal  2  and  its  specific  practices  in  this  process  area. 

Example  Work  Products 

1 .  Records  of  project  performance 

2.  Records  of  significant  deviations 

3.  Cost  performance  reports 

Example  Supplier  Deliverables 

1 .  Supplier  project  progress  and  performance  reports 

2.  Records  of  significant  deviations 

3.  Cost  performance  reports 

Subpractices 

1 .  Monitor  progress  against  the  schedule. 

i  Progress  monitoring  typically  includes  the  following: 

:  •  Periodically  measuring  the  actual  completion  of  activities  and  milestones 

i  •  Comparing  actual  completion  of  activities  and  milestones  against  the  project  plan 
i  schedule 

|  •  Identifying  significant  deviations  from  the  project  plan  schedule  estimates 

2.  Monitor  the  project’s  costs  and  expended  effort. 

j  An  example  of  a  system  for  monitoring  and  updating  the  project’s  costs  and  expended 
I  effort  is  an  Earned  Value  Management  System  (EVMS)  [EIA  2002b], 

:  Effort  and  cost  monitoring  typically  includes  the  following: 

:  •  Periodically  measuring  the  actual  effort  and  costs  expended  and  staff  assigned 

i  •  Comparing  actual  effort,  costs,  staffing,  and  training  to  the  project  plan  budget  and 
j  estimates 

]  •  Identifying  significant  deviations  from  the  project  plan  budget  and  estimates 

3.  Monitor  the  attributes  of  work  products  and  tasks. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  developing  and  sustaining  a  measurement  capability 
used  to  support  management  information  needs. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
establishing  estimates  of  work  product  and  task  attributes. 
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Monitoring  the  attributes  of  work  products  and  tasks  typically  includes  the  following: 

•  Periodically  measuring  the  actual  attributes  of  work  products  and  tasks,  such  as 
size,  complexity,  or  service  levels  (and  changes  to  these  attributes) 

•  Comparing  the  actual  attributes  of  work  products  and  tasks  (and  changes  to  these 
attributes)  to  the  project  plan  estimates 

•  Identifying  significant  deviations  from  the  project  plan  estimates 


Monitoring  attributes  applies  to  both  acquirer  and  supplier  work  products  and  tasks. 

4.  Monitor  resources  provided  and  used. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
planning  the  project’s  resources. 

This  resource  monitoring  includes  monitoring  the  availability  of  resources  provided  by 
the  supplier  for  the  project. 

j  Examples  of  resources  include  the  following: 

i  •  Physical  facilities 

j  •  Computers,  peripherals,  and  software 

j  •  Networks 

:  •  Security  environment 

i  •  Project  staff 

j  •  Processes 

5.  Monitor  the  knowledge  and  skills  of  project  staff. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
planning  needed  knowledge  and  skills. 

:  Monitoring  the  knowledge  and  skills  of  project  staff  typically  includes  the  following: 
j  •  Periodically  measuring  the  acquisition  of  knowledge  and  skills  by  project  staff 
j  •  Comparing  the  actual  training  obtained  to  that  documented  in  the  project  plan 
j  •  Identifying  significant  deviations  from  the  project  plan  estimates 

Staff  monitoring  includes  monitoring  the  skills  and  knowledge  of  supplier  staff  provided 
for  the  project. 

6.  Document  significant  deviations  in  project  planning  parameters. 

Document  significant  deviations  that  apply  either  to  acquirer  project  execution  or  to 
supplier  deviations  from  the  project  plan. 

Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  supplier  agreements. 
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SP  1.2  Monitor  Commitments 

Monitor  commitments  against  those  identified  in  the  project  plan. 

Resource  commitments  that  result  in  expenditures  (e.g.,  issued  purchase 
orders  and  completed  supplier  deliverables  that  are  accepted)  are  tracked 
when  the  expense  is  incurred,  even  prior  to  formal  payment,  to  ensure  that 
future  financial  and  legal  obligations  are  accounted  for  as  soon  as  they  are 
incurred.  Commitments  that  do  not  result  in  expenditures  (e.g.,  allocation  of 
resources  or  skill  sets)  should  also  be  monitored. 

Supplier  commitments  for  the  project  are  also  monitored  by  the  acquirer 
through  these  practices. 

Example  Work  Products 

1 .  Records  of  commitment  reviews 

Subpractices 

1 .  Regularly  review  commitments  (both  external  and  internal). 

2.  Identify  commitments  that  have  not  been  satisfied  or  are  at  significant 
risk  of  not  being  satisfied. 

3.  Document  the  results  of  commitment  reviews. 

SP1.3  Monitor  Project  Risks 

Monitor  risks  against  those  identified  in  the  project  plan. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
identifying  project  risks. 

Refer  to  the  Risk  Management  process  area  for  more  information  about 
identifying  potential  problems  before  they  occur  so  that  risk  handling 
activities  can  be  planned  and  invoked  as  needed  across  the  life  of  the 
product  or  project  to  mitigate  adverse  impacts  on  achieving  objectives. 

The  acquirer  monitors  the  overall  project  risk.  Many  risks  are  the  sole 
responsibility  of  the  acquirer  and  can  include  information  that  should  not  be 
shared  with  the  supplier  (e.g.,  source  selection  sensitive,  re-competition, 
internal  staffing). 

There  can  also  be  risks  that  require  careful  coordination  with  suppliers  and 
the  establishment  of  appropriate  mechanisms  for  the  escalation  of  risks  and 
risk  status  (e.g.,  feasibility  of  the  technology  to  meet  end-user  functionality 
and  quality  attribute  requirements).  Shared  risks  can  require  jointly  planned 
mitigations. 

Example  Work  Products 

1 .  Records  of  project  risk  monitoring 

Example  Supplier  Deliverables 

1 .  Records  of  supplier  risk  monitoring 
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Subpractices 

1 .  Periodically  review  the  documentation  of  risks  in  the  context  of  the 
project’s  current  status  and  circumstances. 

This  review  includes  the  risks  defined  in  the  solicitation  package,  risks  identified  by  the 
supplier  in  their  proposal,  and  risks  raised  as  part  of  regular  supplier  status  reporting. 

2.  Revise  the  documentation  of  risks  as  additional  information  becomes 
available. 

As  projects  progress  (especially  projects  of  long  duration  or  continuous  operation), 
new  risks  arise.  It  is  important  to  identify  and  analyze  these  new  risks.  For  example, 
software,  equipment,  and  tools  in  use  can  become  obsolete;  or  key  staff  can  gradually 
lose  skills  in  areas  of  particular  long-term  importance  to  the  project  and  organization. 

3.  Communicate  the  risk  status  to  relevant  stakeholders. 

:  Examples  of  risk  status  include  the  following: 
i  •  A  change  in  the  probability  that  the  risk  occurs 
i  •  A  change  in  risk  priority 


SP1.4  Monitor  Data  Management 

Monitor  the  management  of  project  data  against  the  project  plan. 

Refer  to  the  Plan  Data  Management  specific  practice  in  the  Project 
Planning  process  area  for  more  information  about  identifying  types  of  data 
to  be  managed  and  how  to  plan  for  their  management. 

Data  management  activities  should  be  monitored  to  ensure  that  data 
management  requirements  are  being  satisfied.  Depending  on  the  results  of 
monitoring  and  changes  in  project  requirements,  situation,  or  status,  it  may 
be  necessary  to  re-plan  the  project’s  data  management  activities. 

Example  Work  Products 

1 .  Records  of  data  management 

Example  Supplier  Deliverables 

1 .  Records  of  supplier  data  management 

Subpractices 

1 .  Periodically  review  data  management  activities  against  their 
description  in  the  project  plan. 

2.  Identify  and  document  significant  issues  and  their  impacts. 

:  An  example  of  a  significant  issue  is  when  stakeholders  do  not  have  the  access  to 
j  project  data  they  need  to  fulfill  their  roles  as  relevant  stakeholders. 

3.  Document  results  of  data  management  activity  reviews. 
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SP  1.5  Monitor  Stakeholder  Involvement 

Monitor  stakeholder  involvement  against  the  project  plan. 

Refer  to  the  Plan  Stakeholder  Involvement  specific  practice  in  the  Project 
Planning  process  area  for  more  information  about  identifying  relevant 
stakeholders  and  planning  appropriate  involvement  with  them. 

Stakeholder  involvement  should  be  monitored  to  ensure  that  appropriate 
interactions  occur.  Depending  on  the  results  of  monitoring  and  changes  in 
project  requirements,  situation,  or  status,  it  may  be  necessary  to  re-plan 
stakeholder  involvement. 

This  monitoring  is  particularly  important  in  a  system  of  systems  environment 
in  which  the  involvement  of  owners,  acquirers,  and  customers  of  other 
systems  in  the  system  of  systems  is  crucial  to  the  success  of  that  system  of 
systems. 

This  monitoring  is  also  particularly  important  in  an  environment  in  which  a 
supplier  is  using  an  Agile  method,  in  which  case  the  sustained  involvement 
of  end  users  or  their  proxies  in  the  supplier’s  product  development  activities 
can  be  crucial  to  developing  and  validating  one  or  more  elements  of  the 
overall  capability  to  be  provided. 

Refer  to  the  Plan  Stakeholder  Involvement  specific  practice  in  the  Project 
Planning  process  area  for  more  information  about  supporting  the  use  of 
Agile  methods. 

Example  Work  Products 

1 .  Records  of  stakeholder  involvement 

Example  Supplier  Deliverables 

1 .  Records  of  supplier  involvement 

Subpractices 

1 .  Periodically  review  the  status  of  stakeholder  involvement. 

2.  Identify  and  document  significant  issues  and  their  impacts. 

3.  Document  the  results  of  stakeholder  involvement  status  reviews. 

SP  1.6  Conduct  Progress  Reviews 

Periodically  review  the  project’s  progress,  performance,  and 
issues. 

A  “project’s  progress”  is  the  project’s  status  as  viewed  at  a  particular  time 
when  the  project  activities  performed  so  far  and  their  results  and  impacts 
are  reviewed  with  relevant  stakeholders  (especially  project  representatives 
and  project  management)  to  determine  whether  there  are  significant  issues 
or  performance  shortfalls  to  be  addressed. 

Progress  reviews  are  project  reviews  to  keep  relevant  stakeholders 
informed.  These  project  reviews  can  be  informal  and  may  not  be  specified 
explicitly  in  project  plans. 
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Refer  to  the  Agreement  Management  process  area  for  more  information 
about  monitoring  selected  supplier  processes. 

Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  monitoring  selected  supplier  processes. 

Example  Work  Products 

1 .  Documented  project  review  results 

Example  Supplier  Deliverables 

1 .  Supplier  project  progress  and  performance  reports 

2.  Supplier  review  materials  and  reports 

3.  Documentation  of  product  and  document  deliveries 

Subpractices 

1 .  Regularly  communicate  status  on  assigned  activities  and  work 
products  to  relevant  stakeholders. 

Managers,  staff,  customers,  end  users,  suppliers,  and  other  relevant  stakeholders  are 
included  in  reviews  as  appropriate. 

2.  Review  the  results  of  collecting  and  analyzing  measures  for  controlling 
the  project. 

i - 

i  Examples  of  classes  of  commonly  used  acquirer  measures  include  the  following: 

|  •  Requirements  volatility 
j  •  Return  on  investment 
j  •  Cost  performance  index 

:  •  Number  of  defects  per  phase  and  by  severity  of  defects 
i  •  Schedule  performance  index 
i  •  Customer  satisfaction  trends 
:  •  Supplier  performance  and  relationship  trends 

Refer  to  the  Measurement  and  Analysis  process  area  for  more 
information  about  aligning  measurement  and  analysis  activities  and 
providing  measurement  results. 

3.  Identify  and  document  significant  issues  and  deviations  from  the  plan. 

This  activity  includes  identifying  and  documenting  both  acquirer  and  supplier  issues 
and  deviations. 

4.  Document  change  requests  and  problems  identified  in  work  products 
and  processes. 

Refer  to  the  Configuration  Management  process  area  for  more 
information  about  tracking  and  controlling  changes. 

5.  Document  the  results  of  reviews. 

6.  Track  change  requests  and  problem  reports  to  closure. 


266 


Project  Monitoring  and  Control  (PMC) 


CMMI  for  Acquisition,  Version  1.3 


SP1.7  Conduct  Milestone  Reviews 

Review  the  project’s  accomplishments  and  results  at  selected 
project  milestones. 

Refer  to  the  Establish  the  Budget  and  Schedule  specific  practice  in  the 
Project  Planning  process  area  for  more  information  about  identifying  major 
milestones. 

Milestones  are  pre-planned  events  or  points  in  time  at  which  a  thorough 
review  of  status  is  conducted  to  understand  how  well  stakeholder 
requirements  are  being  met.  (If  the  project  includes  a  developmental 
milestone,  then  the  review  is  conducted  to  ensure  that  the  assumptions  and 
requirements  associated  with  that  milestone  are  being  met.)  Milestones  can 
be  associated  with  the  overall  project  or  a  particular  service  type  or 
instance.  Milestones  can  thus  be  event  based  or  calendar  based. 

Milestone  reviews  are  planned  during  project  planning  and  are  typically 
formal  reviews. 

Progress  reviews  and  milestone  reviews  need  not  be  held  separately.  A 
single  review  can  address  the  intent  of  both.  For  example,  a  single  pre¬ 
planned  review  can  evaluate  progress,  issues,  and  performance  up  through 
a  planned  time  period  (or  milestone)  against  the  plan’s  expectations. 

Depending  on  the  project,  “project  startup”  and  “project  close-out”  could  be 
phases  covered  by  milestone  reviews. 

Example  Work  Products 

1 .  Documented  milestone  review  results 

Example  Supplier  Deliverables 

1 .  Documented  measurement  results 

2.  Measurement  analysis  reports 

Subpractices 

1 .  Conduct  milestone  reviews  with  relevant  stakeholders  at  meaningful 
points  in  the  project’s  schedule,  such  as  the  completion  of  selected 
phases. 

Managers,  staff,  customers,  end  users,  suppliers,  and  other  relevant  stakeholders  are 
included  in  milestone  reviews  as  appropriate. 

Conduct  milestone  reviews  with  the  supplier  as  specified  in  the  supplier  agreement. 

Refer  to  the  Acquisition  Technical  Management  process  area  for  more 
information  about  conducting  technical  reviews. 

Refer  to  the  Establish  the  Supplier  Agreement  specific  practice  in  the 
Solicitation  and  Supplier  Agreement  Development  process  area  for 
more  information  about  establishing  review  requirements  in  the 
supplier  agreement. 

2.  Review  commitments,  the  plan,  status,  and  risks  of  the  project. 

3.  Identify  and  document  significant  issues  and  their  impacts. 
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4.  Document  results  of  the  review,  action  items,  and  decisions. 

5.  Track  action  items  to  closure. 

SP  1 .8  Monitor  T ransition  to  Operations  and  Support 

Monitor  transition  to  operations  and  support. 

The  acquirer  monitors  and  controls  the  transition  of  the  accepted  product  or 
service  against  the  plan  for  transition  to  operations  and  support. 

Refer  to  the  Plan  Transition  to  Operations  and  Support  specific  practice  in 
the  Project  Planning  process  area  for  more  information  about  planning  for 
the  transition  of  the  product  or  service  to  operations  and  support. 

Typically,  the  supplier  has  a  role  in  integrating  and  packaging  products  and 
prepares  for  the  transition  to  operations  and  support,  including  support  for 
business  user  acceptance;  the  acquirer  monitors  these  supplier  activities. 
These  expectations  of  the  supplier  and  the  acceptance  criteria  for  transition 
to  operations  and  support  are  included  in  the  solicitation  package  and  then 
the  supplier  agreement. 

Example  Work  Products 

1.  Transition  readiness  report 

2.  Records  of  transition  to  support  reviews 

3.  Transition  analysis  report 

Example  Supplier  Deliverables 

1 .  Training  materials  and  supporting  artifacts 

2.  Site  readiness  report 

3.  Verification  reports 

4.  Training  records 

5.  Operational  readiness  reports 

6.  Test  results 

7.  Pilot  results 
Subpractices 

1 .  Monitor  the  operations  and  support  organization’s  capability  and 
facilities  designated  to  receive,  store,  use,  and  maintain  acquired 
products. 

The  acquirer  makes  adequate  provisions  through  the  supplier  agreement  or  in-house 
operations  and  support  organizations  to  operate  the  acquired  product.  Typically,  the 
acquirer  uses  verification  practices  to  confirm  that  the  organization,  physical 
environment,  and  operations  and  support  resources  are  equipped  to  execute 
operations  and  support  activities. 

The  acquirer  also  reviews  operations  and  support  organizations  designated  to  take 
responsibility  for  the  operation  of  the  product  and  to  ensure  that  resources  identified 
and  budgeted  are  available  when  needed.  The  designated  operations  and  support 
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organizations  demonstrate  their  readiness  (i.e.,  capability,  capacity)  to  accept 
responsibility  for  the  product  and  to  ensure  uninterrupted  support.  Typically,  a 
demonstration  involves  execution  of  all  the  activities  of  operations  (e.g.,  a  pilot). 

2.  Monitor  the  delivery  of  training  for  those  who  are  involved  in  receiving, 
storing,  using,  and  maintaining  acquired  products. 

Typically,  the  supplier  develops  training  resources  for  the  product.  Training  materials 
and  resources  are  specified  in  the  supplier  agreement  to  meet  the  needs  of  various 
audiences  (e.g.,  operations  and  support  staff,  end  users).  The  acquirer  verifies  that 
training  is  provided  at  the  appropriate  time  to  the  appropriate  audience  and  determines 
whether  the  training  capability  provided  is  adequate. 

3.  Review  pilot  results,  if  any,  and  operational  readiness  reports  for  the 
acquired  product. 

Determine  readiness  of  the  product  and  involved  stakeholders,  such  as  the  operations 
and  support  organizations,  for  the  transition  of  responsibility.  The  acquirer  typically 
uses  transition  readiness  criteria  and  verification  and  validation  practices  to  determine 
if  the  supplier  delivered  products  meet  specified  requirements.  The  criteria  also 
address  the  readiness  of  the  product  for  maintenance  over  the  intended  product 
lifecycle. 

4.  Review  and  analyze  the  results  of  transition  activities. 

The  acquirer  reviews  and  analyzes  the  results  of  transition  activities  and  determines 
whether  corrective  actions  must  be  completed  before  responsibility  is  transferred  to  the 
operational  and  support  organizations. 

:  Example  reports  and  logs  used  by  the  acquirer  include  the  following: 

:  •  Transition  activity  reports,  including  quality  measures  collected  during  the  pilot  and 

i  the  warranty  period 

:  •  Problem  tracking  reports,  detailing  resolution  time,  escalation,  and  root  cause 

:  analysis 

i  •  Change  management  reports 

i  •  Configuration  management  records 

I  •  Operation  logs  to  determine  that  sufficient  information  is  stored  to  support 
reconstruction 

:  •  Security  reports 

i  •  Actual  operations  and  support  costs  compared  to  estimates 


SG  2 _ Manage  Corrective  Action  to  Closure _ 

Corrective  actions  are  managed  to  closure  when  the  project’s  performance  or 
results  deviate  significantly  from  the  plan. 

When  the  acquirer  determines  (e.g.,  through  its  monitoring  of  measurement 
data)  that  supplier  progress  does  not  appear  to  be  sufficient  to  meet  a 
service  level  defined  in  the  supplier  agreement,  then  the  acquirer  initiates 
and  manages  corrective  action  with  the  supplier. 
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If  the  supplier  does  not  comply  appropriately  with  the  acquirer’s  initiation  of 
corrective  action,  the  acquirer  escalates  and  resolves  this  issue  as  a 
supplier  agreement  issue. 

SP  2.1  Analyze  Issues 

Collect  and  analyze  issues  and  determine  corrective  actions  to 
address  them. 

Corrective  action  is  taken  for  both  acquirer  deviations  and  when  supplier 
execution  does  not  align  with  project  planning  (e.g.,  milestones  and  work 
product  date  slippages). 

Many  issues  and  corrective  actions  are  the  sole  responsibility  of  the 
acquirer  and  can  include  information  that  should  not  be  shared  with  the 
supplier  (e.g.,  source  selection  sensitive,  re-competition,  internal  staffing). 

Example  Work  Products 

1 .  List  of  issues  requiring  corrective  actions 

Example  Supplier  Deliverables 

1 .  List  of  supplier  issues  needing  corrective  action  by  the  acquirer 

Subpractices 

1 .  Gather  issues  for  analysis. 

Issues  are  collected  from  reviews  and  the  execution  of  other  processes. 

:  Examples  of  issues  to  be  gathered  include  the  following: 

:  •  Issues  discovered  when  performing  technical  reviews,  verification,  and  validation 

|  •  Significant  deviations  in  project  planning  parameters  from  estimates  in  the  project 
:  plan 

j  •  Commitments  (either  internal  or  external)  that  have  not  been  satisfied 
:  •  Significant  changes  in  risk  status 
:  •  Data  access,  collection,  privacy,  or  security  issues 
i  •  Stakeholder  representation  or  involvement  issues 

:  •  Product,  tool,  or  environment  transition  assumptions  (or  other  customer  or  supplier 
commitments)  that  have  not  been  achieved 

2.  Analyze  issues  to  determine  the  need  for  corrective  action. 

Refer  to  the  Establish  the  Budget  and  Schedule  specific  practice  in  the 
Project  Planning  process  area  for  more  information  about  corrective 
action  criteria. 

Corrective  action  is  required  when  the  issue,  if  left  unresolved,  may  prevent  the  project 
from  meeting  its  objectives. 

SP  2.2  Take  Corrective  Action 

Take  corrective  action  on  identified  issues. 

Some  corrective  actions  can  be  assigned  to  a  supplier.  The  acquirer 
oversees  corrective  actions  assigned  to  the  supplier  as  appropriate. 
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Example  Work  Products 

1 .  Corrective  action  plans 

Example  Supplier  Deliverables 

1 .  Corrective  action  plans  for  supplier  issues 

Subpractices 

1 .  Determine  and  document  the  appropriate  actions  needed  to  address 
identified  issues. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
developing  a  project  plan. 

i - 

i  Examples  of  potential  actions  include  the  following: 

|  •  Modifying  the  statement  of  work 
I  •  Modifying  requirements 
:  •  Revising  estimates  and  plans 
:  •  Renegotiating  commitments 
i  •  Adding  resources 
:  •  Changing  processes 
:  •  Revising  project  risks 

2.  Review  and  get  agreement  with  relevant  stakeholders  on  the  actions  to 
be  taken. 

3.  Negotiate  changes  to  internal  and  external  commitments. 

SP  2.3  Manage  Corrective  Actions 

Manage  corrective  actions  to  closure. 

Example  Work  Products 

1 .  Corrective  action  results 

Example  Supplier  Deliverables 

1 .  Corrective  action  results  for  supplier  issues 

Subpractices 

1 .  Monitor  corrective  actions  for  their  completion. 

2.  Analyze  results  of  corrective  actions  to  determine  the  effectiveness  of 
the  corrective  actions. 

3.  Determine  and  document  appropriate  actions  to  correct  deviations  from 
planned  results  from  performing  corrective  actions. 

Lessons  learned  as  a  result  of  taking  corrective  action  can  be  inputs  to  planning  and 
risk  management  processes. 
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PROJECT  PLANNING 


A  Project  Management  Process  Area  at  Maturity  Level  2 


Purpose 


The  purpose  of  Project  Planning  (PP)  is  to  establish  and  maintain  plans  that 
define  project  activities. 


Introductory  Notes 


One  of  the  keys  to  effectively  managing  a  project  is  project  planning.  The 
Project  Planning  process  area  involves  the  following  activities: 

•  Developing  the  project  plan 

•  Interacting  with  relevant  stakeholders  appropriately 

•  Getting  commitment  to  the  plan 

•  Maintaining  the  plan 

Planning  begins  with  requirements  that  define  the  product  and  project. 

Project  planning  is  based  on  the  acquisition  strategy,  which  is  a  guide  for 
directing  and  controlling  the  project  and  a  framework  for  integrating 
activities  essential  to  acquiring  an  operational  product  or  service.  The 
acquisition  strategy  outlines  acquisition  objectives  and  constraints, 
availability  of  assets  and  technologies,  consideration  of  acquisition 
methods,  potential  supplier  agreement  types  and  terms,  accommodation  of 
end-user  considerations,  considerations  of  risk,  and  support  for  the  project 
throughout  the  project  lifecycle. 

Planning  includes  estimating  the  attributes  of  work  products  and  tasks, 
determining  the  resources  needed,  negotiating  commitments,  producing  a 
schedule,  and  identifying  and  analyzing  project  risks.  Iterating  through 
these  activities  may  be  necessary  to  establish  the  project  plan.  The  project 
plan  provides  the  basis  for  performing  and  controlling  project  activities  that 
address  commitments  with  the  project’s  customer.  (See  the  definition  of 
“project”  in  the  glossary.) 

Project  Planning  involves  the  development  and  maintenance  of  plans  for  all 
acquirer  processes,  including  plans  required  for  effective  acquirer-supplier 
interaction.  Once  the  supplier  agreement  is  signed  and  schedule,  costs, 
and  resources  from  the  supplier  are  established,  the  acquirer  takes  the 
supplier  estimations  for  the  project  into  account  at  an  appropriate  level  of 
detail  in  its  project  plan. 
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Project  planning  includes  establishing  and  maintaining  a  plan  for  the 
orderly,  smooth  transition  of  the  acquired  product  from  a  supplier  to  its  use 
by  the  acquirer  or  its  customers.  In  addition,  if  an  existing  product  is  to  be 
replaced  as  part  of  the  acquisition,  the  acquirer  may  be  required  to  consider 
the  disposal  of  the  existing  product  as  part  of  the  planning  for  acquiring  the 
new  product.  All  transition  activities  are  included  in  the  project  plan  and 
provisions  for  accommodating  such  specialized  requirements  are  also 
included. 

All  relevant  stakeholders  should  be  involved  in  the  planning  process  from  all 
lifecycle  phases  to  ensure  all  technical  and  support  activities  are  adequately 
addressed  in  project  plans. 

The  project  plan  is  usually  revised  as  the  project  progresses  to  address 
changes  in  requirements  and  commitments,  inaccurate  estimates, 
corrective  actions,  and  process  changes.  Specific  practices  describing  both 
planning  and  replanning  are  contained  in  this  process  area. 

Changes  to  the  supplier  agreement  can  also  affect  the  project’s  planning 
estimates,  budget,  schedules,  risks,  project  work  tasks,  commitments,  and 
resources. 

The  term  “project  plan”  is  used  throughout  this  process  area  to  refer  to  the 
overall  plan  for  controlling  the  project.  The  project  plan  can  be  a  stand¬ 
alone  document  or  be  distributed  across  multiple  documents.  In  either  case, 
a  coherent  picture  of  who  does  what  should  be  included.  Likewise, 
monitoring  and  control  can  be  centralized  or  distributed,  as  long  as  at  the 
project  level  a  coherent  picture  of  project  status  can  be  maintained. 

Related  Process  Areas 


Refer  to  the  Acquisition  Requirements  Development  process  area  for  more 
information  about  developing  and  analyzing  customer  and  contractual 
requirements. 

Refer  to  the  Acquisition  Technical  Management  process  area  for  more 
information  about  evaluating  the  supplier’s  technical  solution  and  managing 
selected  interfaces  of  that  solution. 

Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  supplier  agreements. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  specifying  measures. 

Refer  to  the  Requirements  Management  process  area  for  more  information 
about  managing  requirements. 

Refer  to  the  Risk  Management  process  area  for  more  information  about 
identifying  and  analyzing  risks  and  mitigating  risks. 
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Specific  Goal  and  Practice  Summary 

SG  1  Establish  Estimates 


SP  1.1 

Establish  the  Acquisition  Strategy 

SP  1.2 

Estimate  the  Scope  of  the  Project 

SP  1.3 

Establish  Estimates  of  Work  Product  and  Task  Attributes 

SP  1.4 

Define  Project  Lifecycle  Phases 

SP  1.5 

Estimate  Effort  and  Cost 

SG  2  Develop  a  Project  Plan 

SP  2.1 

Establish  the  Budget  and  Schedule 

SP  2.2 

Identify  Project  Risks 

SP  2.3 

Plan  Data  Management 

SP  2.4 

Plan  the  Project’s  Resources 

SP  2.5 

Plan  Needed  Knowledge  and  Skills 

SP  2.6 

Plan  Stakeholder  Involvement 

SP  2.7 

Plan  Transition  to  Operations  and  Support 

SP  2.8 

Establish  the  Project  Plan 

SG  3  Obtain  Commitment  to  the  Plan 

SP  3.1 

Review  Plans  That  Affect  the  Project 

SP  3.2 

Reconcile  Work  and  Resource  Levels 

SP  3.3 

Obtain  Plan  Commitment 

Specific  Practices  by  Goal 


SG  1 _ Establish  Estimates _ 

Estimates  of  project  planning  parameters  are  established  and  maintained. 

Project  planning  parameters  include  all  information  needed  by  the  project  to 
perform  necessary  planning,  organizing,  staffing,  directing,  coordinating, 
reporting,  and  budgeting. 

The  acquirer  develops  estimates  for  project  work  based  on  the  acquisition 
strategy,  including  high-level  estimates  for  the  work  to  be  done  by  suppliers. 
Initial  estimates  can  be  revised  based  on  supplier  estimates  in  response  to 
the  solicitation  package. 

Estimates  of  planning  parameters  should  have  a  sound  basis  to  instill 
confidence  that  plans  based  on  these  estimates  are  capable  of  supporting 
project  objectives. 
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Factors  to  consider  when  estimating  these  parameters  include  the  following: 

•  The  acquisition  strategy 

•  Project  requirements,  including  product  requirements,  requirements  imposed  by  the 
organization,  requirements  imposed  by  the  customer,  and  other  requirements  that  affect 
the  project 

•  The  scope  of  the  project 

•  Identified  tasks  and  work  products 

•  The  technical  approach 

•  The  selected  project  lifecycle  model  (e.g.,  waterfall,  incremental,  spiral) 

•  Attributes  of  work  products  and  tasks  (e.g.,  size,  complexity) 

•  The  schedule 

•  Models  or  historical  data  used  for  converting  attributes  of  work  products  and  tasks  into 
labor  hours  and  costs 

•  The  methodology  (e.g.,  models,  data,  algorithms)  used  to  determine  needed  material, 
skills,  labor  hours,  and  cost 


The  acquisition  strategy  is  a  key  factor  when  estimating  the  project. 

Documentation  of  the  estimating  rationale  and  supporting  data  is  needed 
for  stakeholder  review  and  commitment  to  the  plan  and  for  maintenance  of 
the  plan  as  the  project  progresses. 

SP  1.1  Establish  the  Acquisition  Strategy 

Establish  and  maintain  the  acquisition  strategy. 

The  acquisition  strategy  is  the  business  and  technical  management 
framework  for  planning,  executing,  and  managing  agreements  for  a  project. 
The  acquisition  strategy  relates  to  the  objectives  for  the  acquisition,  the 
constraints,  availability  of  resources  and  technologies,  consideration  of 
acquisition  methods,  potential  supplier  agreement  types,  terms  and 
conditions,  accommodation  of  business  considerations,  considerations  of 
risk,  and  support  for  the  acquired  product  over  its  lifecycle.  The  acquisition 
strategy  reflects  the  entire  scope  of  the  project.  It  encompasses  the  work  to 
be  performed  by  the  acquirer  and  the  supplier,  or  in  some  cases  multiple 
suppliers,  for  the  full  lifecycle  of  the  product. 

The  acquisition  strategy  results  from  a  thorough  understanding  of  both  the 
acquisition  project  and  the  general  acquisition  environment.  The  acquirer 
accounts  for  the  potential  value  or  benefit  of  the  acquisition  in  the  light  of 
potential  risks,  considers  constraints,  and  takes  into  account  experiences 
with  different  types  of  suppliers,  agreements,  and  terms.  A  well-developed 
strategy  minimizes  the  time  and  cost  required  to  satisfy  approved  capability 
needs,  and  maximizes  affordability  throughout  the  project  lifecycle. 

The  acquisition  strategy  is  the  basis  for  formulating  solicitation  packages, 
supplier  agreements,  and  project  plans.  The  strategy  evolves  over  time  and 
should  continuously  reflect  the  current  status  and  desired  end  point  of  the 
project. 


276 


Project  Planning  (PP) 


CMMI  for  Acquisition,  Version  1.3 


Example  Work  Products 

1 .  Acquisition  strategy 

Subpractices 

1 .  Identify  the  capabilities  and  objectives  the  acquisition  is  intended  to 
satisfy  or  provide. 

The  capabilities  describe  what  the  organization  intends  to  acquire.  Typically,  the 
capabilities  included  in  the  acquisition  strategy  highlight  product  characteristics  driven 
by  interoperability  or  families  of  products.  The  acquisition  strategy  also  identifies 
dependencies  on  planned  or  existing  capabilities  of  other  projects  or  products. 

Refer  to  the  Acquisition  Requirements  Development  process  area  for 
more  information  about  developing  and  analyzing  customer  and 
contractual  requirements. 

The  acquirer  defines  objectives  in  terms  of  cost,  schedule,  and  performance. 
Performance  related  objectives  are  stated  in  terms  of  and  key  process,  product,  and 
service  level  measures  and  technical  performance  measures  as  defined  in 
requirements.  These  measures  reflect  customer  expectations  and  threshold  values 
representing  acceptable  limits  for  key  quality  attributes  (addressing,  e.g., 
responsiveness,  safety,  reliability,  and  maintainability)  that,  in  the  customer’s 
judgment,  provide  the  needed  capability.  While  the  number  and  specificity  of  measures 
can  change  over  the  duration  of  an  acquisition,  the  acquirer  typically  focuses  on  the 
minimum  number  of  measures  that,  if  thresholds  are  not  met,  will  require  a  re- 
evaluation  of  the  project. 

The  acquisition  strategy  establishes  the  milestone  decision  points  and  acquisition 
phases  planned  for  the  project.  It  prescribes  the  accomplishments  for  each  phase  and 
identifies  the  critical  events  affecting  project  management.  Schedule  parameters 
include,  at  a  minimum,  the  projected  dates  for  project  initiation,  other  major  decision 
points,  and  initial  operational  capability. 

:  Examples  of  cost  parameters  include  the  following: 

|  •  Research,  development,  test,  and  evaluation  costs 
j  •  Acquisition  costs 

:  •  Acquisition  related  operations,  support,  and  disposal  costs 

:  •  Total  product  quantity  (to  include  both  fully  configured  development  and  production 
:  units) 


2.  Identify  the  acquisition  approach. 

The  acquirer  defines  the  approach  the  project  will  use  to  achieve  full  capability,  e.g., 
whether  evolutionary  or  single  step,  and  includes  a  brief  rationale  to  justify  the  choice. 
When  a  project  uses  an  evolutionary  acquisition  approach,  the  acquisition  strategy 
describes  the  initial  capability  and  how  it  will  be  funded,  developed,  tested,  produced, 
and  supported.  The  acquisition  strategy  previews  similar  planning  for  subsequent 
increments  and  identifies  the  approach  to  integrate  or  retrofit  earlier  increments  with 
later  increments. 
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Examples  of  considerations  for  the  acquisition  approach  include  the  following: 

•  Actions  a  project  team  can  take  on  its  own  if  the  acquiring  organization  has  an 
acquisition,  contracting,  or  purchasing  department 

•  Who  will  prepare  objective  estimates  and  if  these  estimates  are  needed  as 
evaluation  criteria 

•  Managing  multiple  suppliers 

•  Anticipated  lead  times  from  potential  suppliers  to  acquire  items 


3.  Document  business  considerations. 

Business  considerations  include  the  type  of  competition  planned  for  all  phases  of  the 
acquisition  or  an  explanation  of  why  competition  is  not  practicable  or  not  in  the  best 
interests  of  the  acquirer.  Also  included  are  considerations  for  establishing  or 
maintaining  access  to  competitive  suppliers  for  critical  products  or  product 
components. 

Availability  and  suitability  of  commercial  items  and  the  extent  to  which  interfaces  for 
these  items  have  broad  market  acceptance,  standards,  organization  support,  and 
stability  are  other  business  considerations.  Also  included  are  considerations  for  both 
international  and  domestic  sources  that  can  meet  the  required  need  as  primary 
sources  of  supply  consistent  with  organizational  policies  and  regulations. 

i  Other  examples  of  business  considerations  for  an  acquisition  strategy  include  the 
i  following: 

:  •  Product  and  technology  areas  critical  to  satisfying  or  providing  the  desired 
i  capabilities 

j  •  Data  rights 

j  •  Product  line  considerations 

:  •  Socio-economic  constraints 

:  •  Safety  and  health  issues 

i  •  Security  issues  (physical  and  information  technology) 

i  •  Other  business  oriented  product  quality  attributes  that  can  be  market  differentiators 
:  or  mission  critical  (e.g.,  product  responsiveness,  platform  openness,  availability, 

:  sustainability) 


4.  Identify  major  risks  and  which  risks  will  be  addressed  jointly  with  the 
supplier. 

Major  acquisition  risks,  whether  primarily  managed  by  the  acquirer  or  supplier,  should 
be  identified  and  assessed  by  the  acquirer.  The  acquisition  strategy  identifies  major 
risks,  which  risks  are  to  be  shared  with  the  supplier,  and  which  are  retained  by  the 
acquirer. 

Refer  to  the  Risk  Management  process  area  for  more  information 
about  establishing  a  risk  management  strategy. 

5.  Identify  the  preferred  type  of  supplier. 

The  acquirer  identifies  standardized  acquisition  documents  (e.g.,  standard  supplier 
agreements),  if  any.  The  acquirer  also  determines  the  preferred  type  of  supplier 
agreement  (e.g.,  firm  fixed-price;  fixed-price  incentive,  firm  target;  cost  plus  incentive 
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fee;  cost  plus  award  fee)  and  the  reasons  it  is  suitable,  including  considerations  of  risk 
and  reasonable  risk  sharing  by  the  acquirer  and  supplier. 

The  acquisition  strategy  explains  the  planned  incentive  structure  for  the  acquisition 
and  how  it  encourages  the  supplier  to  provide  the  product  or  service  at  or  below  the 
established  cost  objectives  and  satisfy  the  schedule  and  key  measurement  objectives. 
Considerations  should  be  given  to  using  incentives  to  reduce  primary  project  risks.  If 
more  than  one  incentive  is  planned  for  a  supplier  agreement,  the  acquisition  strategy 
explains  how  the  incentives  complement  one  another  and  do  not  interfere  with  one 
another.  The  acquisition  strategy  identifies  unusual  terms  and  conditions  of  the 
planned  supplier  agreement  and  all  existing  or  contemplated  deviations  to  an 
organization’s  terms  and  conditions,  if  any. 

6.  Identify  the  product  support  strategy. 

The  acquirer  develops  a  product  support  strategy  for  lifecycle  sustainment  and 
continuous  improvement  of  product  affordability,  reliability,  and  supportability,  while 
sustaining  readiness.  The  support  strategy  addresses  how  the  acquirer  will  maintain 
oversight  of  the  fielded  product  and  ensure  satisfaction  of  support  related  quality 
attributes. 

If  support  is  going  to  be  performed  by  an  organization  different  from  the  supplier,  a 
sufficient  overlap  period  should  be  defined  to  ensure  smooth  transition. 

The  acquirer’s  sustainment  organization  or  supplier  typically  participates  in  the 
development  of  the  product  support  strategy. 

7.  Review  and  obtain  agreement  with  senior  management  on  the 
acquisition  strategy. 

The  development  of  the  acquisition  strategy  for  a  project  typically  requires  senior 
management  sponsorship.  Appropriate  senior  management  should  approve  the 
acquisition  strategy  before  initiating  a  project. 

SP  1 .2  Estimate  the  Scope  of  the  Project 

Establish  a  top-level  work  breakdown  structure  (WBS)  to  estimate 
the  scope  of  the  project. 

The  acquirer  establishes  the  objectives  of  the  project  in  the  acquisition 
strategy.  An  initial  set  of  requirements  and  project  objectives  form  the  basis 
for  establishing  the  WBS  or  for  selecting  a  standard  WBS  from 
organizational  process  assets.  To  ensure  the  full  scope  of  the  project  is 
estimated,  the  WBS  includes  activities  performed  by  the  acquirer  as  well  as 
milestones  and  deliverables  for  suppliers. 

The  acquisition  strategy  drives  a  key  decision  in  this  practice,  specifically 
how  much  work,  and  what  work,  to  give  to  a  supplier.  The  acquirer 
develops  a  WBS  that  clearly  identifies  the  project  work  performed  by  the 
acquirer  and  the  project  work  performed  by  the  supplier.  The  supplier  work 
identified  in  the  WBS  becomes  the  foundation  for  the  statement  of  work 
defined  in  the  Solicitation  and  Supplier  Agreement  Development  process 
area.  The  WBS  identifies  deliverables  from  the  supplier  and  work  products 
developed  by  the  acquirer. 
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The  WBS  evolves  with  the  project.  A  top-level  WBS  can  serve  to  structure 
initial  estimating.  The  development  of  a  WBS  divides  the  overall  project  into 
an  interconnected  set  of  manageable  components. 

Typically,  the  WBS  is  a  product,  work  product,  or  task  oriented  structure 
that  provides  a  scheme  for  identifying  and  organizing  the  logical  units  of 
work  to  be  managed,  which  are  called  “work  packages.”  The  WBS  provides 
a  reference  and  organizational  mechanism  for  assigning  effort,  schedule, 
and  responsibility  and  is  used  as  the  underlying  framework  to  plan, 
organize,  and  control  the  work  done  on  the  project. 

Some  projects  use  the  term  “contract  WBS”  to  refer  to  the  portion  of  the 
WBS  placed  under  contract  (possibly  the  entire  WBS).  Not  all  projects  have 
a  contract  WBS  (e.g.,  internally  funded  development). 

Example  Work  Products 

1.  Task  descriptions 

2.  Work  package  descriptions 

3.  WBS 
Subpractices 

1 .  Develop  a  WBS  based  on  the  product  architecture. 

The  WBS  provides  a  scheme  for  organizing  the  project’s  work.  The  WBS  should  permit 
the  identification  of  the  following  items: 

•  Risks  and  their  mitigation  tasks 

•  Tasks  for  deliverables  and  supporting  activities 

•  Tasks  for  skill  and  knowledge  acquisition 

•  Tasks  for  the  development  of  needed  support  plans,  such  as  configuration 
management,  quality  assurance,  and  verification  plans 

•  Tasks  for  the  integration  and  management  of  nondevelopmental  items 

2.  Define  the  work  packages  in  sufficient  detail  so  that  estimates  of 
project  tasks,  responsibilities,  and  schedule  can  be  specified. 

The  top-level  WBS  is  intended  to  help  gauge  the  project  work  effort  for  tasks  and 
organizational  roles  and  responsibilities.  The  amount  of  detail  in  the  WBS  at  this  level 
helps  in  developing  realistic  schedules,  thereby  minimizing  the  need  for  management 
reserve. 

3.  Identify  products  and  product  components  to  be  externally  acquired. 

4.  Identify  work  products  to  be  reused. 

SP  1.3  Establish  Estimates  of  Work  Product  and  Task  Attributes 

Establish  and  maintain  estimates  of  work  product  and  task 
attributes. 

Size  is  the  primary  input  to  many  models  used  to  estimate  effort,  cost,  and 
schedule.  Models  can  also  be  based  on  other  attributes  such  as  service 
level,  connectivity,  complexity,  availability,  and  structure. 
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Estimation  methods  include  using  historical  acquirer  and  supplier  data  and 
standard  estimating  models  to  compare  projects  of  similar  complexity. 
Where  historical  size  data  are  not  available,  develop  an  estimate  based  on 
the  understanding  of  the  design  of  similar  products. 

Estimation  models  can  be  built  based  on  historical  data  as  part  of 
organizational  process  performance,  and  estimates  for  any  project  can  be 
validated  using  these  models. 

Refer  to  the  Organizational  Process  Performance  process  area  for  more 
information  about  establishing  process  performance  models. 

i - 

j  Examples  of  attributes  to  estimate  include  the  following: 

|  •  Number  of  logic  gates  for  integrated  circuits 

:  •  Number  of  parts  (e.g.,  printed  circuit  boards,  components,  mechanical  parts) 

i  •  Physical  constraints  (e.g.,  weight,  volume) 

i  •  Number  of  pages 

:•  Number  of  inputs  and  outputs 

j  •  Number  of  technical  risk  items 

|  •  Number  of  functions 

:  •  Function  points 

i  •  Source  lines  of  code 

i  •  Amount  of  code  to  be  reused  versus  created 

i  •  Number  of  classes  and  objects 

j  •  Number  and  complexity  of  requirements 

|  •  Number  and  complexity  of  interfaces 

:  •  Volume  of  data 

i  •  Maturity  of  the  technology  specified  in  the  technical  solution 

:  •  Amount  and  complexity  of  the  work  potentially  assigned  to  suppliers 

i  •  Number  of  locations  where  the  product  is  to  be  installed 

j  •  Experience  of  project  participants 

|  •  Team  velocity  or  productivity 

:  •  Geographic  dispersal  of  project  members 

i  •  Proximity  of  customers,  end  users,  and  suppliers 


The  estimates  should  be  consistent  with  project  requirements  to  determine 
the  project’s  effort,  cost,  and  schedule.  A  relative  level  of  difficulty  or 
complexity  should  be  assigned  for  each  size  attribute. 

Example  Work  Products 

1 .  Size  and  complexity  of  tasks  and  work  products 

2.  Estimating  models 

3.  Attribute  estimates 

4.  Technical  approach 
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Subpractices 

1 .  Determine  the  technical  approach  for  the  project. 

The  technical  approach  defines  a  top-level  strategy  for  development  of  the  product.  It 
includes  decisions  on  architectural  features,  such  as  distributed  or  client/server;  state- 
of-the-art  or  established  technologies  to  be  applied,  such  as  robotics,  composite 
materials,  or  artificial  intelligence;  and  the  functionality  and  quality  attributes  expected 
in  the  final  products,  such  as  safety,  security,  and  ergonomics. 

The  technical  approach  provides  a  basis  for  interoperability  and  supportability  of  the 
technical  solution  developed  by  the  supplier.  The  technical  approach  is  often 
developed  as  part  of  and  included  in  the  acquisition  strategy. 

2.  Use  appropriate  methods  to  determine  the  attributes  of  the  work 
products  and  tasks  to  be  used  to  estimate  resource  requirements. 

Methods  for  determining  size  and  complexity  should  be  based  on  validated  models  or 
historical  data. 

The  methods  for  determining  attributes  evolve  as  the  understanding  of  the  relationship 
of  product  characteristics  to  attributes  increases. 

i  Examples  of  attributes  include  the  following: 
i  •  Maturity  of  the  technology  specified  in  the  technical  solution 
:  •  Amount  and  complexity  of  the  work  potentially  assigned  to  suppliers 
•  Number  of  locations  where  the  product  is  to  be  installed 

3.  Estimate  the  attributes  of  work  products  and  tasks. 

:  Examples  of  work  products  for  which  size  estimates  are  made  include  the  following: 
i  •  Deliverable  and  nondeliverable  work  products 
j  •  Documents  and  files 

j  •  Operational  and  support  hardware,  firmware,  and  software 


SP  1.4  Define  Project  Lifecycle  Phases 

Define  project  lifecycle  phases  on  which  to  scope  the  planning 
effort. 

The  determination  of  a  project’s  lifecycle  phases  provides  for  planned 
periods  of  evaluation  and  decision  making.  These  periods  are  normally 
defined  to  support  logical  decision  points  at  which  the  appropriateness  of 
continued  reliance  on  the  project  plan  and  strategy  is  determined  and 
significant  commitments  are  made  concerning  resources.  Such  points 
provide  planned  events  at  which  project  course  corrections  and 
determinations  of  future  scope  and  cost  can  be  made. 

Understanding  the  project  lifecycle  is  crucial  in  determining  the  scope  of  the 
planning  effort  and  the  timing  of  initial  planning,  as  well  as  the  timing  and 
criteria  (critical  milestones)  for  replanning. 

Depending  on  the  nature  of  the  project,  explicit  phases  for  “project  startup” 
and  “project  close-out”  can  be  included  in  the  lifecycle. 
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Project  lifecycle  phases  should  be  defined  depending  on  the  scope  of 
requirements,  estimates  for  project  resources,  and  the  nature  of  the  project. 

The  acquirer  includes  the  entire  project  lifecycle  (i.e.,  from  end  user  needs 
through  initial  and  subsequent  upgrades)  when  planning  lifecycle  phases 
and  refines  the  acquisition  strategy  as  appropriate.  The  acquirer  considers 
all  supplier  agreements  in  the  context  of  the  acquisition  so  that  an 
integrated  approach  results.  A  complex  project  can  involve  managing 
multiple  supplier  agreements  simultaneously  or  in  sequence.  In  such  cases, 
any  acquisition  lifecycle  can  end  during  any  phase  of  the  project  lifecycle. 
Depending  on  the  acquisition  strategy,  there  can  be  intermediate  phases  for 
the  creation  of  prototypes,  increments  of  capability,  or  spiral  model  cycles. 

Refer  to  the  Establish  Lifecycle  Model  Descriptions  specific  practice  in  the 
Organizational  Process  Definition  process  area  for  more  information  about 
acquisition  lifecycles. 

During  establishment  of  the  supplier  agreement,  the  acquirer  works  with  the 
supplier  to  understand  supplier  lifecycle  models  and  processes,  especially 
those  models  and  processes  that  interact  directly  with  acquirer  processes. 
Agreement  on  the  lifecycle  models  and  processes  to  be  used  during  the 
project  enables  seamless  interactions  between  supplier  and  acquirer, 
resulting  in  a  successful  acquirer-supplier  relationship. 

Example  Work  Products 

1 .  Project  lifecycle  phases 

SP  1 .5  Estimate  Effort  and  Cost 

Estimate  the  project’s  effort  and  cost  for  work  products  and  tasks 
based  on  estimation  rationale. 

Estimates  of  effort  and  cost  are  generally  based  on  results  of  analysis  using 
models  or  historical  data  applied  to  size,  activities,  and  other  planning 
parameters.  Confidence  in  these  estimates  is  based  on  rationale  for  the 
selected  model  and  the  nature  of  the  data.  There  can  be  occasions  when 
available  historical  data  do  not  apply,  such  as  when  efforts  are 
unprecedented  or  when  the  type  of  task  does  not  fit  available  models.  For 
example,  an  effort  can  be  considered  unprecedented  if  the  organization  has 
no  experience  with  such  a  product  or  task. 

Unprecedented  efforts  are  more  risky,  require  more  research  to  develop 
reasonable  bases  of  estimate,  and  require  more  management  reserve.  The 
uniqueness  of  the  project  should  be  documented  when  using  these  models 
to  ensure  a  common  understanding  of  any  assumptions  made  in  the  initial 
planning  phases. 

Estimates  address  all  processes  and  activities  performed  by  the  project  for 
the  project  lifecycle,  including  an  estimate  of  effort  and  cost  for  supplier 
work.  The  project  estimate  includes  detailed  estimates  for  activities 
performed  by  the  acquirer  and  its  stakeholders.  The  acquirer  should  include 
members  of  their  technical  community  (e.g.,  systems,  hardware,  software 
engineers)  to  ensure  all  technical  considerations  have  been  accounted  for 
in  the  estimates.  As  the  project  evolves,  these  estimates  can  be  revised 
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based  on  changed  conditions  (e.g.,  new  circumstances  encountered  during 
execution  of  the  supplier  agreement). 

In  addition  to  creating  an  estimate  for  the  project  work  products,  the 
acquirer  is  encouraged  to  have  its  estimate  and  WBS  reviewed  by 
individuals  external  to  the  project  to  ensure  that  the  project  estimation  and 
WBS  can  be  validated. 

Example  Work  Products 

1.  Estimation  rationale 

2.  Project  effort  estimates 

3.  Project  cost  estimates 

Subpractices 

1 .  Collect  models  or  historical  data  to  be  used  to  transform  the  attributes 
of  work  products  and  tasks  into  estimates  of  labor  hours  and  costs. 

Effort  estimation  at  the  work  product  and  task  level  needs  to  be  established  for 
acquirer  work.  Effort  estimation  for  supplier  deliverables  and  processes  should  be 
established  as  well. 

Many  parametric  models  have  been  developed  to  help  estimate  cost  and  schedule. 
The  use  of  these  models  as  the  sole  source  of  estimation  is  not  recommended 
because  these  models  are  based  on  historical  project  data  that  may  or  may  not  be 
pertinent  to  the  project.  Multiple  models  and  methods  can  be  used  to  ensure  a  high 
level  of  confidence  in  the  estimate. 

Historical  data  should  include  the  cost,  effort,  and  schedule  data  from  previously 
executed  projects  and  appropriate  scaling  data  to  account  for  differing  sizes  and 
complexity. 

2.  Include  supporting  infrastructure  needs  when  estimating  effort  and 
cost. 

The  supporting  infrastructure  includes  resources  needed  from  a  development  and 
sustainment  perspective  for  the  product. 

Consider  the  infrastructure  resource  needs  in  the  development  environment,  the  test 
environment,  the  production  environment,  the  operational  environment,  or  any 
appropriate  combination  of  these  environments  when  estimating  effort  and  cost. 

:  Examples  of  supporting  infrastructure  typically  provided  by  the  supplier  include  the 
|  following: 

|  •  Critical  computing  resources  in  the  host  and  testing  environment  (e.g.,  memory, 

I  disk,  network  capability) 

i  •  Test  equipment 

3.  Estimate  effort  and  cost  using  models,  historical  data,  or  a  combination 
of  both. 
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Examples  of  effort  and  cost  inputs  used  for  estimating  typically  include  the  following: 

•  Facilities  needed  (e.g.,  office  and  meeting  space  and  workstations) 

•  Estimates  for  the  development  of  requirements 

•  Costs  of  acquired  work  products 

•  Travel 

•  Estimates  provided  by  an  expert  or  group  of  experts  (e.g.,  Delphi  Method) 

•  Risks,  including  the  extent  to  which  the  effort  is  unprecedented 

•  Critical  competencies  and  roles  needed  to  perform  the  work 

•  WBS 

•  Selected  project  lifecycle  model  and  processes 

•  Lifecycle  cost  estimates 

•  Skill  levels  of  managers  and  staff  needed  to  perform  the  work 

•  Knowledge,  skill,  and  training  needs 

•  Direct  labor  and  overhead 

•  Service  agreements  for  call  centers  and  warranty  work 

•  Level  of  security  required  for  tasks,  work  products,  hardware,  software,  staff,  and 
work  environment 


The  amount  of  supplier  work  for  a  project  largely  determines  the  amount  of  acquirer 
work  required  to  manage  the  project  and  the  supplier.  Effort  for  the  acquirer  includes 
(1)  effort  associated  with  defining  the  scope  of  the  project;  (2)  effort  associated  with 
the  development  of  the  solicitation  and  supplier  agreement;  agreement  and  technical 
management;  project  planning,  monitoring,  and  control;  acquisition  requirements 
development,  verification,  and  validation;  configuration  management;  measurement 
and  analysis;  process  and  product  quality  assurance;  requirements  management;  and 
risk  management;  (3)  operating  and  maintenance  effort  associated  with  the 
sustainment  of  the  solution;  and  (4)  disposal  effort. 

SG  2 _ Develop  a  Project  Plan _ 

A  project  plan  is  established  and  maintained  as  the  basis  for  managing  the 
project. 

A  project  plan  is  a  formal,  approved  document  used  to  manage  and  control 
the  execution  of  the  project.  It  is  based  on  project  requirements  and 
established  estimates. 

The  project  plan  should  consider  all  phases  of  the  project  lifecycle.  Project 
planning  should  ensure  that  all  plans  affecting  the  project  are  consistent 
with  the  overall  project  plan. 

SP  2.1  Establish  the  Budget  and  Schedule 

Establish  and  maintain  the  project’s  budget  and  schedule. 

The  project’s  budget  and  schedule  are  based  on  developed  estimates  and 
ensure  that  budget  allocation,  task  complexity,  and  task  dependencies  are 
appropriately  addressed. 
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The  project’s  budget  and  schedule  (including  the  lifecycle  related  activities 
of  the  acquirer)  the  supplier’s  efforts  and  efforts  of  supporting  organizations 
and  other  stakeholders  (including  any  supplier  that  supports  the  acquirer) 
are  established,  tracked,  and  maintained  for  the  duration  of  the  project.  In 
addition  to  creating  a  schedule  for  project  work  products,  the  acquirer 
should  have  the  schedule  reviewed  by  individuals  external  to  the  project  to 
ensure  that  the  project  schedule  can  be  validated. 

Event  driven,  resource-limited  schedules  have  proven  to  be  effective  in 
dealing  with  project  risk.  Identifying  accomplishments  to  be  demonstrated 
before  initiation  of  an  event  provides  some  flexibility  in  the  timing  of  the 
event,  a  common  understanding  of  what  is  expected,  a  better  vision  of  the 
state  of  the  project,  and  a  more  accurate  status  of  the  project’s  tasks. 

Example  Work  Products 

1.  Project  schedules 

2.  Schedule  dependencies 

3.  Project  budget 

Subpractices 

1 .  Identify  major  milestones. 

Milestones  are  pre-planned  events  or  points  in  time  at  which  a  thorough  review  of 
status  is  conducted  to  understand  how  well  stakeholder  requirements  are  being  met. 
(If  the  project  includes  a  developmental  milestone,  then  the  review  is  conducted  to 
ensure  that  the  assumptions  and  requirements  associated  with  that  milestone  are 
being  met.)  Milestones  can  be  associated  with  the  overall  project  or  a  particular 
service  type  or  instance.  Milestones  can  thus  be  event  based  or  calendar  based.  If 
calendar  based,  once  agreed,  milestone  dates  are  often  difficult  to  change. 

2.  Identify  schedule  assumptions. 

When  schedules  are  initially  developed,  it  is  common  to  make  assumptions  about  the 
duration  of  certain  activities.  These  assumptions  are  frequently  made  on  items  for 
which  little  if  any  estimation  data  are  available.  Identifying  these  assumptions  provides 
insight  into  the  level  of  confidence  (i.e.,  uncertainties)  in  the  overall  schedule. 

3.  Identify  constraints. 

Factors  that  limit  the  flexibility  of  management  options  should  be  identified  as  early  as 
possible.  The  examination  of  the  attributes  of  work  products  and  tasks  often  bring 
these  issues  to  the  surface.  Such  attributes  can  include  task  duration,  resources, 
inputs,  and  outputs. 

Since  key  characteristics  of  pre-qualified  or  other  potential  suppliers  are  elements  of 
project  success,  the  acquirer  considers  these  characteristics  (e.g.,  technical  and 
financial  capability,  management  and  delivery  processes,  production  capacity, 
business  type  and  size)  in  identifying  constraints  for  the  project. 

4.  Identify  task  dependencies. 

Frequently,  the  tasks  for  a  project  or  service  can  be  accomplished  in  some  ordered 
sequence  that  minimizes  the  duration.  This  sequencing  involves  the  identification  of 
predecessor  and  successor  tasks  to  determine  optimal  ordering. 


286 


Project  Planning  (PP) 


CMMI  for  Acquisition,  Version  1.3 


Examples  of  tools  and  inputs  that  can  help  determine  optimal  ordering  of  task  activities 
include  the  following: 

•  Critical  chain  method 

•  Critical  Path  Method  (CPM) 

•  Program  Evaluation  and  Review  Technique  (PERT) 

•  Resource  limited  scheduling 

•  Customer  priorities 

•  End-user  value 


5.  Establish  and  maintain  the  budget  and  schedule. 

i  An  example  of  a  system  used  for  documenting  the  costs  and  schedule  of  a  project  is 
|  an  EVMS  [EIA2002]. 

:  Establishing  and  maintaining  the  project’s  budget  and  schedule  typically  includes  the 
:  following: 

j  •  Determining  the  approach  to  incorporating  supplier  schedules  at  an  appropriate 
j  level  of  detail 

j  •  Defining  the  committed  or  expected  availability  of  resources  and  facilities 
:  •  Determining  the  time  phasing  of  activities 
i  •  Determining  a  breakout  of  subordinate  schedules 

i  •  Defining  dependencies  among  activities  (predecessor  or  successor  relationships) 

:  •  Defining  schedule  activities  and  milestones  to  support  project  monitoring  and 
:  control 

i  •  Identifying  milestones,  releases,  or  increments  for  the  delivery  of  products  to  the 
j  customer 

j  •  Defining  activities  of  appropriate  duration 
:  •  Defining  milestones  of  appropriate  time  separation 

:  •  Defining  a  management  reserve  based  on  the  confidence  level  in  meeting  the 
:  schedule  and  budget 

i  •  Using  appropriate  historical  data  to  verify  the  schedule 
:  •  Defining  incremental  funding  requirements 
i  •  Documenting  project  assumptions  and  rationale 


6.  Establish  corrective  action  criteria. 

Criteria  are  established  for  determining  what  constitutes  a  significant  deviation  from 
the  project  plan.  A  basis  for  gauging  issues  and  problems  is  necessary  to  determine 
when  corrective  action  should  be  taken.  Corrective  actions  can  lead  to  replanning, 
which  may  include  revising  the  original  plan,  establishing  new  agreements,  or  including 
mitigation  activities  in  the  current  plan.  The  project  plan  defines  when  (e.g.,  under  what 
circumstances,  with  what  frequency)  the  criteria  will  be  applied  and  by  whom. 
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SP  2.2  Identify  Project  Risks 

Identify  and  analyze  project  risks. 

Refer  to  the  Monitor  Project  Risks  specific  practice  in  the  Project  Monitoring 
and  Control  process  area  for  more  information  about  risk  monitoring 
activities. 

Refer  to  the  Risk  Management  process  area  for  more  information  about 
identifying  potential  problems  before  they  occur  so  that  risk  handling 
activities  can  be  planned  and  invoked  as  needed  across  the  life  of  the 
product  or  project  to  mitigate  adverse  impacts  on  achieving  objectives. 

Risks  are  identified  or  discovered  and  analyzed  to  support  project  planning. 
This  specific  practice  should  be  extended  to  all  plans  that  affect  the  project 
to  ensure  that  appropriate  interfacing  is  taking  place  among  all  relevant 
stakeholders  on  identified  risks. 

j  Project  planning  risk  identification  and  analysis  typically  include  the  following: 
i  •  Identifying  risks 

j  •  Analyzing  risks  to  determine  the  impact,  probability  of  occurrence,  and  time  frame  in 
i  which  problems  are  likely  to  occur 

:  •  Prioritizing  risks 


Risks  are  identified  from  multiple  perspectives  (e.g.,  acquisition,  technical, 
management,  operational,  supplier  agreement,  industry,  support,  end  user) 
to  ensure  all  project  risks  are  considered  comprehensively  in  planning 
activities.  Applicable  regulatory  and  statutory  requirements  with  respect  to 
safety  and  security  should  be  considered  while  identifying  risks. 

The  acquisition  strategy  and  the  risks  identified  in  other  project  planning 
activities  form  the  basis  for  some  of  the  criteria  used  in  evaluation  practices 
in  the  Solicitation  and  Supplier  Agreement  Development  process  area.  As 
the  project  evolves,  risks  can  be  revised  based  on  changed  conditions. 

Example  Work  Products 

1 .  Identified  risks 

2.  Risk  impacts  and  probability  of  occurrence 

3.  Risk  priorities 

Subpractices 

1 .  Identify  risks. 

The  identification  of  risks  involves  the  identification  of  potential  issues,  hazards, 
threats,  vulnerabilities,  and  so  on  that  could  negatively  affect  work  efforts  and  plans. 
Risks  should  be  identified  and  described  understandably  before  they  can  be  analyzed 
and  managed  properly.  When  identifying  risks,  it  is  a  good  idea  to  use  a  standard 
method  for  defining  risks.  Risk  identification  and  analysis  tools  can  be  used  to  help 
identify  possible  problems. 
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Examples  of  risk  identification  and  analysis  tools  include  the  following: 

•  Risk  taxonomies 

•  Risk  assessments 

•  Checklists 

•  Structured  interviews 

•  Brainstorming 

•  Process,  project,  and  product  performance  models 

•  Cost  models 

•  Network  analysis 

•  Quality  factor  analysis 


Numerous  risks  are  associated  with  acquiring  products  through  suppliers  (e.g.,  the 
stability  of  the  supplier,  the  ability  to  maintain  sufficient  insight  into  the  progress  of  their 
work,  the  supplier’s  capability  to  meet  product  requirements,  the  skills  and  availability 
of  supplier  resources  to  meet  commitments). 

The  process,  product,  and  service  level  measures  and  associated  thresholds  should 
be  analyzed  to  identify  instances  where  thresholds  are  at  risk  of  not  being  met.  These 
project  measures  are  key  indicators  of  project  risk. 

2.  Document  risks. 

3.  Review  and  obtain  agreement  with  relevant  stakeholders  on  the 
completeness  and  correctness  of  documented  risks. 

4.  Revise  risks  as  appropriate. 

:  Examples  of  when  identified  risks  may  need  to  be  revised  include  the  following: 

:  •  When  new  risks  are  identified 
i  •  When  risks  become  problems 
j  •  When  risks  are  retired 
j  •  When  project  circumstances  change  significantly 


SP  2.3  Plan  Data  Management 

Plan  for  the  management  of  project  data. 

Data  are  forms  of  documentation  required  to  support  a  project  in  all  of  its 
areas  (e.g.,  administration,  engineering,  configuration  management, 
finance,  logistics,  quality,  safety,  manufacturing,  procurement).  The  data 
can  take  any  form  (e.g.,  reports,  manuals,  notebooks,  charts,  drawings, 
specifications,  files,  correspondence).  The  data  can  exist  in  any  medium 
(e.g.,  printed  or  drawn  on  various  materials,  photographs,  electronic, 
multimedia). 

Data  can  be  deliverable  (e.g.,  items  identified  by  a  project’s  contract  data 
requirements)  or  data  can  be  nondeliverable  (e.g.,  informal  data,  trade 
studies,  analyses,  internal  meeting  minutes,  internal  design  review 
documentation,  lessons  learned,  action  items).  Distribution  can  take  many 
forms,  including  electronic  transmission. 
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Data  requirements  for  the  project  should  be  established  for  both  data  items 
to  be  created  and  their  content  and  form,  based  on  a  common  or  standard 
set  of  data  requirements.  Uniform  content  and  format  requirements  for  data 
items  facilitate  understanding  of  data  content  and  help  with  consistent 
management  of  data  resources. 

The  reason  for  collecting  each  document  should  be  clear.  This  task 
includes  the  analysis  and  verification  of  project  deliverables  and 
nondeliverables,  data  requirements,  and  customer  supplied  data.  Often, 
data  are  collected  with  no  clear  understanding  of  how  they  will  be  used. 
Data  are  costly  and  should  be  collected  only  when  needed. 

Project  data  include  both  acquirer  and  supplier  created  data.  The  acquirer 
identifies  the  minimal  data  required  to  cost  effectively  operate,  maintain, 
and  improve  the  acquired  product  and  to  foster  source-of-support 
competition  throughout  the  product’s  lifecycle  in  the  acquirer’s  intended 
environment.  Data  should  be  available  in  a  format  that  is  compatible  with 
the  intended  end  user’s  environment  and  a  quality  assurance  program 
should  be  implemented  to  guarantee  the  accuracy  and  completeness  of 
data. 

The  acquirer  considers  how  data  will  be  shared  between  acquirer  and 
supplier  as  well  as  across  relevant  stakeholders.  In  many  cases,  leaving 
acquirer  data  in  the  physical  possession  of  the  supplier  and  having  access 
to  supplier  data  is  the  preferred  solution.  In  addition  to  data  access,  the 
requirement  for  acquirer  use,  reproduction,  manipulation,  alteration,  or 
transfer  of  possession  of  data  should  be  part  of  the  data  management  plan. 
The  supplier  agreement  specifies  appropriate  acquirer  rights  to  the  data 
acquired,  in  addition  to  requirements  for  delivery  or  access. 

Data,  when  delivered  to  the  acquirer,  are  formatted  according  to  accepted 
data  standards  to  ensure  their  usability  by  the  acquirer.  Planning  for 
managing  data,  including  during  transition  to  operations  and  support,  is 
addressed  as  part  of  project  planning  to  avoid  unexpected  costs  to  procure, 
reformat,  and  deliver  data.  Plans  for  managing  data  in  project  teams  and 
the  infrastructure  required  to  manage  data  between  the  supplier, 
operational  users,  and  other  relevant  stakeholders  are  included. 

Project  data  and  plans  requiring  version  control  or  more  stringent  levels  of 
configuration  control  are  determined  and  mechanisms  established  to 
ensure  project  data  are  controlled.  The  implications  of  controlling  access  to 
classified  and  sensitive  data  (e.g.,  proprietary,  export  controlled,  source 
selection  sensitive)  and  other  access  controlled  data  also  should  be 
considered. 

Example  Work  Products 

1 .  Data  management  plan 

2.  Master  list  of  managed  data 

3.  Data  content  and  format  description 

4.  Lists  of  data  requirements  for  acquirers  and  suppliers 


290 


Project  Planning  (PP) 


CMMI  for  Acquisition,  Version  1.3 


5.  Privacy  requirements 

6.  Security  requirements 

7.  Security  procedures 

8.  Mechanisms  for  data  retrieval,  reproduction,  and  distribution 

9.  Schedule  for  the  collection  of  project  data 

1 0.  List  of  project  data  to  be  collected 

Subpractices 

1 .  Establish  requirements  and  procedures  to  ensure  privacy  and  the 
security  of  data. 

Not  everyone  will  have  the  need  or  clearance  necessary  to  access  project  data. 
Procedures  should  be  established  to  identify  who  has  access  to  which  data  as  well  as 
when  they  have  access  to  which  data. 

Security  and  access  control  are  critical  when  the  acquirer  provides  data  access  to  the 
supplier.  Security  and  access  control  includes  access  lists  of  authorized  supplier  staff 
and  non-disclosure  agreements  between  the  acquirer  and  supplier. 

:  For  example,  when  the  supplier  performs  work  for  the  acquirer  off-site  (e.g.,  off-shore 
i  development  center),  the  acquirer  should  consider  additional  security  measures  such 
j  as  a  firewall  between  acquirer  and  supplier  networks  and  restricted  access  to  the 
I  acquirer’s  work  place. 

2.  Establish  a  mechanism  to  archive  data  and  to  access  archived  data. 

Accessed  information  should  be  in  an  understandable  form  (e.g.,  electronic  or 
computer  output  from  a  database)  or  represented  as  originally  generated. 

The  data  management  plan  is  ideally  supported  by  an  integrated  data  system  that 
meets  the  needs  of  both  initial  acquisition  and  support  communities.  Integrating 
acquisition  and  sustainment  data  systems  into  a  total  lifecycle  integrated  data 
environment  provides  the  capability  needed  to  plan  effectively  for  sustainment  and  to 
facilitate  technology  insertion  for  affordability  improvements  during  re-procurement  and 
post-production  support,  while  ensuring  that  acquisition  planners  have  accurate 
information  about  total  lifecycle  costs. 

3.  Determine  the  project  data  to  be  identified,  collected,  and  distributed. 

4.  Determine  the  requirements  for  providing  access  to  and  distribution  of 
data  to  relevant  stakeholders. 

A  review  of  other  elements  of  the  project  plan  can  help  to  determine  who  requires 
access  to  or  receipt  of  project  data  as  well  as  which  data  are  involved. 

5.  Decide  which  project  data  and  plans  require  version  control  or  other 
levels  of  configuration  control  and  establish  mechanisms  to  ensure 
project  data  are  controlled. 
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SP  2.4  Plan  the  Project’s  Resources 

Plan  for  resources  to  perform  the  project. 

Defining  project  resources  (e.g.,  labor,  equipment,  materials,  methods)  and 
quantities  needed  to  perform  project  activities  builds  on  initial  estimates  and 
provides  additional  information  that  can  be  applied  to  expand  the  WBS 
used  to  manage  the  project. 

The  top-level  WBS  developed  earlier  as  an  estimation  mechanism  is 
typically  expanded  by  decomposing  these  top  levels  into  work  packages 
that  represent  single  work  units  that  can  be  separately  assigned, 
performed,  and  tracked.  This  subdivision  is  done  to  distribute  management 
responsibility  and  provide  better  management  control. 

Each  work  package  in  the  WBS  should  be  assigned  a  unique  identifier 
(e.g.,  number)  to  permit  tracking.  A  WBS  can  be  based  on  requirements, 
activities,  work  products,  services,  or  a  combination  of  these  items.  A 
dictionary  that  describes  the  work  for  each  work  package  in  the  WBS 
should  accompany  the  work  breakdown  structure. 

The  resource  plan  should  include  planning  for  staff  with  appropriate  training 
and  experience  to  evaluate  supplier  proposals  and  participate  in 
negotiations  with  suppliers.  The  resource  plan  identifies  the  project 
resources  expected  from  the  supplier,  including  critical  facilities  or 
equipment  needed  to  support  the  work.  The  resource  plan  can  be  revised 
based  on  the  supplier  agreement  or  changes  in  conditions  during  project 
execution. 

Example  Work  Products 

1 .  Work  packages 

2.  WBS  task  dictionary 

3.  Staffing  requirements  based  on  project  size  and  scope 

4.  Critical  facilities  and  equipment  list 

5.  Process  and  workflow  definitions  and  diagrams 

6.  Project  administration  requirements  list 

7.  Status  reports 
Subpractices 

1 .  Determine  process  requirements. 

The  processes  used  to  manage  a  project  are  identified,  defined,  and  coordinated  with 
all  relevant  stakeholders  to  ensure  efficient  operations  during  project  execution. 

The  acquirer  determines  how  its  processes  interact  with  supplier  processes  to  enable 
seamless  execution  of  the  project  and  successful  acquirer-supplier  relationships. 
Considerations  include  the  use  of  a  common  process  across  multiple  suppliers  and  the 
acquirer  or  the  use  of  unique  but  compatible  processes.  At  least,  processes  should  be 
compatible  across  interfaces. 

2.  Determine  communication  requirements. 
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These  requirements  address  the  kinds  of  mechanisms  to  be  used  for  communicating 
with  customers,  end  users,  project  staff,  and  other  relevant  stakeholders, 

3.  Determine  staffing  requirements. 

The  staffing  of  a  project  depends  on  the  decomposition  of  project  requirements  into 
tasks,  roles,  and  responsibilities  for  accomplishing  project  requirements  as  laid  out  in 
the  work  packages  of  the  WBS. 

Staffing  requirements  should  consider  the  knowledge  and  skills  required  for  each 
identified  position  as  defined  in  the  Plan  Needed  Knowledge  and  Skills  specific 
practice. 

The  acquirer  determines  its  staffing  requirements,  including  staffing  for  solicitation  and 
supplier  agreement  management  activities  and  staffing  expected  by  the  supplier  to 
complete  its  portion  of  the  work  as  defined  in  the  WBS. 

4.  Determine  facility,  equipment,  and  component  requirements. 

Most  projects  are  unique  in  some  way  and  require  a  set  of  unique  assets  to 
accomplish  project  objectives.  The  determination  and  acquisition  of  these  assets  in  a 
timely  manner  are  crucial  to  project  success. 

It  is  best  to  identify  lead-time  items  early  to  determine  how  they  will  be  addressed. 
Even  when  required  assets  are  not  unique,  compiling  a  list  of  all  facilities,  equipment, 
and  parts  (e.g.,  number  of  computers  for  the  staff  working  on  the  project,  software 
applications,  office  space)  provides  insight  into  aspects  of  the  scope  of  an  effort  that 
are  often  overlooked. 

The  acquirer  considers  what  it  may  need  to  provide  for  acceptance  of  supplier 
deliverables  and  for  transition  and  support  of  the  acquired  product. 

The  acquirer  should  also  identify  and  ensure  that  facilities  or  equipment  to  be  provided 
to  the  supplier  for  project  work  are  accounted  for  in  the  project  plan. 

5.  Determine  other  continuing  resource  requirements. 

Beyond  determining  processes,  reporting  templates,  staffing,  facilities,  and  equipment, 
there  may  be  a  continuing  need  for  other  types  of  resources  to  effectively  carry  out 
project  activities,  including  the  following: 

•  Access  to  intellectual  property 

•  Access  to  transportation  (for  people  and  equipment) 

•  Consumables  (e.g.,  electricity,  office  supplies) 

The  requirements  for  such  resources  are  derived  from  the  requirements  found  in 
(existing  and  future)  agreements  (e.g.,  customer  agreements,  service  agreements, 
supplier  agreements),  the  project’s  strategic  approach,  and  the  need  to  manage  and 
maintain  the  project’s  operations  for  a  period  of  time. 

SP  2.5  Plan  Needed  Knowledge  and  Skills 

Plan  for  knowledge  and  skills  needed  to  perform  the  project. 

Refer  to  the  Organizational  Training  process  area  for  more  information 
about  developing  skills  and  knowledge  of  people  so  they  can  perform  their 
roles  effectively  and  efficiently. 


Project  Planning  (PP) 


293 


CMMI  for  Acquisition,  Version  1.3 


Knowledge  delivery  to  projects  involves  training  project  staff  and  acquiring 
knowledge  from  outside  sources. 

Staffing  requirements  are  dependent  on  the  knowledge  and  skills  available 
to  support  the  execution  of  the  project. 

The  acquirer  plans  for  knowledge  and  skills  required  by  the  project  team  to 
perform  their  tasks.  Knowledge  and  skill  requirements  can  be  derived  from 
project  risk. 

For  example,  if  the  acquirer  is  purchasing  a  software-intensive  product,  it  ensures  that 
acquisition  staff  assigned  to  the  project  have  expertise  in  systems  and  software  engineering 
or  provides  training  for  the  project  team  in  these  areas. 


Orientation  and  training  in  acquirer  processes  and  the  domain  knowledge 
required  to  execute  the  project  are  also  required.  The  acquirer  also  plans 
for  knowledge  and  skills  needed  from  the  supplier. 

For  example,  the  acquirer  can  provide  role  descriptions  and  skill  profiles  to  the  supplier  as 
part  of  the  solicitation  package. 


Planning  for  needed  knowledge  and  skills  includes  ensuring  that 
appropriate  training  is  planned  for  staff  involved  in  receiving,  storing,  using, 
and  supporting  the  transitioned  product.  Also  included  is  ensuring  that  costs 
and  funding  sources  to  pay  for  training  are  available  and  lead  times  to 
obtain  the  funding  are  identified. 

Example  Work  Products 

1 .  Inventory  of  skill  needs 

2.  Staffing  and  new  hire  plans 

3.  Databases  (e.g.,  skills,  training) 

4.  Training  plans 
Subpractices 

1 .  Identify  the  knowledge  and  skills  needed  to  perform  the  project. 

2.  Assess  the  knowledge  and  skills  available. 

3.  Select  mechanisms  for  providing  needed  knowledge  and  skills. 

i - 

|  Example  mechanisms  include  the  following: 

|  •  In-house  training  (both  organizational  and  project) 

:  •  External  training 
:  •  Staffing  and  new  hires 
i  •  External  skill  acquisition 


The  choice  of  in-house  training  or  outsourced  training  for  needed  knowledge  and  skills 
is  determined  by  the  availability  of  training  expertise,  the  project’s  schedule,  and 
business  objectives. 
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4.  Incorporate  selected  mechanisms  into  the  project  plan. 

SP  2.6  Plan  Stakeholder  Involvement 

Plan  the  involvement  of  identified  stakeholders. 

Stakeholders  are  identified  from  all  phases  of  the  project  lifecycle  by 
identifying  the  people  and  functions  that  should  be  represented  in  the 
project  and  describing  their  relevance  and  the  degree  of  interaction  for 
project  activities.  A  two-dimensional  matrix  with  stakeholders  along  one  axis 
and  project  activities  along  the  other  axis  is  a  convenient  format  for 
accomplishing  this  identification.  Relevance  of  the  stakeholder  to  the 
activity  in  a  particular  project  phase  and  the  amount  of  interaction  expected 
would  be  shown  at  the  intersection  of  the  project  phase  activity  axis  and  the 
stakeholder  axis. 

Stakeholders  can  include  operational  users  and  project  participants  as  well 
as  potential  suppliers.  When  acquiring  products  that  must  interoperate  with 
other  products,  the  acquirer  plans  the  involvement  of  relevant  stakeholders 
from  other  projects  or  communities  to  ensure  the  delivered  product  can 
perform  as  required  in  its  intended  environment.  Such  planning  often 
includes  steps  for  establishing  and  maintaining  supplier  agreements  with 
these  stakeholders  (e.g.,  interagency  and  intercompany  agreements, 
memoranda  of  understanding,  memoranda  of  agreement). 

For  inputs  of  stakeholders  to  be  useful,  careful  selection  of  relevant 
stakeholders  is  necessary.  For  each  major  activity,  identify  stakeholders 
who  are  affected  by  the  activity  and  those  who  have  expertise  that  is 
needed  to  conduct  the  activity.  This  list  of  relevant  stakeholders  will 
probably  change  as  the  project  moves  through  phases  of  the  project 
lifecycle.  It  is  important,  however,  to  ensure  that  relevant  stakeholders  in 
the  latter  phases  of  the  lifecycle  have  early  input  to  requirements  and 
design  decisions  that  affect  them. 

Sometimes  the  supplier  will  be  using  an  Agile  method.  The  phrase  “Agile 
method”  is  shorthand  for  any  development  or  management  method  that 
adheres  to  the  Manifesto  for  Agile  Development  [ Beck  2001].  More 
guidance  on  the  use  of  Agile  methods  can  be  found  in  CMMI-DEV  Section 
5.0  Interpreting  CMMI  When  Using  Agile  Approaches  and  in  the  SEI 
technical  notes  CMMI  or  Agile:  Why  Not  Embrace  Both!  [Glazer  2008]  and 
Considerations  for  Using  Agile  in  DoD  Acquisition  [Lapham  201 0]. 

When  the  supplier  is  using  an  Agile  method,  the  risk  is  shared  with  the 
acquirer  and  end  users  for  the  product  being  developed.  To  be  effective, 
the  end  user  or  their  proxy,  acquirer,  and  supplier  will  need  to  operate  as  a 
team  that  crosses  organizational  and  contractual  boundaries.  The  results  of 
the  acquirer’s  stakeholder  involvement  planning  can  be  incorporated  in  a 
team  charter  that  defines  roles  and  responsibilities  for  the  three  parties.  For 
example,  the  team  charter  can  specify  who  has  responsibility  for  making 
changes  to  project  scope  and  requirements  and  how  such  changes  will  be 
made  and  managed. 
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Examples  of  the  type  of  material  that  should  be  included  in  a  plan  for  stakeholder  interaction 

include  the  following: 

•  Roles  and  responsibilities  of  relevant  stakeholders  with  respect  to  the  project,  by  project 
lifecycle  phase 

•  Relative  importance  of  the  stakeholder  to  the  success  of  the  project  by  project  lifecycle 
phase 

•  List  of  all  relevant  stakeholders 

•  Rationale  for  stakeholder  involvement 

•  Relationships  among  stakeholders 

•  Resources  (e.g.,  training,  materials,  time,  funding)  needed  to  ensure  stakeholder 
interaction 

•  Schedule  for  the  phasing  of  stakeholder  interaction 


Implementing  this  specific  practice  relies  on  shared  or  exchanged 
information  with  the  previous  Plan  Needed  Knowledge  and  Skills  specific 
practice. 

Example  Work  Products 

1 .  Stakeholder  involvement  plan 

SP  2.7  Plan  Transition  to  Operations  and  Support 

Plan  transition  to  operations  and  support. 

Planning  for  transition  should  be  considered  part  of  initial  planning  for  the 
project. 

Transition  and  support  plans  include  the  approach  for  introducing  and 
maintaining  readiness,  sustainment,  and  the  operational  capability  of  the 
products  delivered  by  the  supplier.  Plans  for  transition  to  operations  and 
support  include  assignment  of  responsibility  for  transition  to  operations  and 
support  of  the  product,  as  well  as  all  activities  needed  to  manage  the 
transition  and  to  support  the  product  in  its  intended  environment  (e.g., 
definition  of  transition  readiness  criteria  agreed  to  by  relevant  stakeholders). 
These  plans  can  include  reasonable  accommodations  for  potential  risks 
and  for  the  evolution  of  acquired  products  and  their  eventual  removal  from 
operational  use. 
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Transition  to  operations  and  support  plans  typically  include  the  following: 

•  Processes  and  procedures  for  the  transition  to  operations  and  support 

•  Evaluation  methods  and  acceptance  criteria  for  ensuring  the  transition  of  the  product  to 
operations  and  support 

•  Readiness  criteria  for  the  product 

•  Readiness  criteria  for  the  operations  organization 

•  Readiness  criteria  for  the  product  support  organization 

•  Expectations  for  supplier  execution  of  the  transition 

•  Warranty  expectations  for  the  acquired  product 

•  Identification  of  the  maintenance  organization 

•  Transition  of  intellectual  property  or  other  acquirer  assets  to  the  acquirer’s  designated 
repository 

•  Resolution  steps  if  any  problems  are  encountered 


If  support  is  to  be  provided  by  an  organization  different  from  the  supplier,  a 
sufficient  overlap  period  should  be  included  in  the  plan. 

Typically,  the  acquirer  develops  initial  transition  and  support  plans  and  then  reviews  and 
approves  more  detailed  transition  and  support  plans. 


Refer  to  the  Agreement  Management  process  area  for  more  information 
about  accepting  the  acquired  product. 

Refer  to  the  Acquisition  Technical  Management  process  area  for  more 
information  about  evaluating  technical  solutions. 

Example  Work  Products 

1 .  Transition  to  operations  and  support  plans 

Subpractices 

1 .  Determine  the  transition  scope  and  objectives. 

2.  Determine  transition  requirements  and  criteria. 

3.  Determine  transition  responsibilities  and  resources  to  include  post¬ 
transition  support  enhancements  and  lifecycle  considerations. 

4.  Determine  configuration  management  needs  of  the  transition. 

5.  Determine  training  needs  for  operations  and  support. 

SP  2.8  Establish  the  Project  Plan 

Establish  and  maintain  the  overall  project  plan. 

A  documented  plan  that  addresses  all  relevant  planning  items  is  necessary 
to  achieve  the  mutual  understanding  and  commitment  of  individuals, 
groups,  and  organizations  that  execute  or  support  the  plans. 

The  plan  generated  for  the  project  defines  all  aspects  of  the  effort,  tying 
together  the  following  in  a  logical  manner: 
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•  Project  lifecycle  considerations 

•  Project  tasks 

•  Budgets  and  schedules 

•  Milestones 

•  Data  management 

•  Risk  identification 

•  Resource  and  skill  requirements 

•  Stakeholder  identification  and  interaction 

•  Infrastructure  considerations 

Infrastructure  considerations  include  responsibility  and  authority 
relationships  for  project  staff,  management,  and  support  organizations. 

The  project  plan  can  include  multiple  plans  such  as  staffing  plans, 
stakeholder  involvement  plans,  measurement  and  analysis  plans, 
monitoring  and  control  plans,  solicitation  plans,  agreement  management 
plans,  risk  mitigation  plans,  transition  plans,  quality  assurance  plans,  and 
configuration  management  plans.  Regardless  of  form,  the  plan  or  plans 
should  address  the  acquisition  strategy  as  well  as  the  cradle-to-grave 
considerations  for  the  project  and  product  to  be  acquired. 

Examples  of  plans  that  have  been  used  in  the  U.S.  Department  of  Defense  community 
include  the  following: 

•  Integrated  Master  Plan— an  event  driven  plan  that  documents  significant 
accomplishments  with  pass/fail  criteria  for  both  business  and  technical  elements  of  the 
project  and  that  ties  each  accomplishment  to  a  key  project  event. 

•  Integrated  Master  Schedule— an  integrated  and  networked  multi-layered  schedule  of 
project  tasks  required  to  complete  the  work  effort  documented  in  a  related  Integrated 
Master  Plan. 

•  Systems  Engineering  Management  Plan— a  plan  that  details  the  integrated  technical 
effort  across  the  project. 

•  Systems  Engineering  Master  Schedule— an  event  based  schedule  that  contains  a 
compilation  of  key  technical  accomplishments,  each  with  measurable  criteria,  requiring 
successful  completion  to  pass  identified  events. 

•  Systems  Engineering  Detailed  Schedule— a  detailed,  time  dependent,  task  oriented 
schedule  that  associates  dates  and  milestones  with  the  Systems  Engineering  Master 
Schedule. 


Example  Work  Products 
1 .  Overall  project  plan 

SG  3  Obtain  Commitment  to  the  Plan 

Commitments  to  the  project  plan  are  established  and  maintained. 

To  be  effective,  plans  require  commitment  by  those  who  are  responsible  for 
implementing  and  supporting  the  plan. 


298 


Project  Planning  (PP) 


CMMI  for  Acquisition,  Version  1.3 


Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  the  supplier  agreement. 

SP  3.1  Review  Plans  That  Affect  the  Project 

Review  all  plans  that  affect  the  project  to  understand  project 
commitments. 

Plans  developed  in  other  process  areas  typically  contain  information  similar 
to  that  called  for  in  the  overall  project  plan.  These  plans  can  provide 
additional  detailed  guidance  and  should  be  compatible  with  and  support  the 
overall  project  plan  to  indicate  who  has  the  authority,  responsibility, 
accountability,  and  control.  All  plans  that  affect  the  project  should  be 
reviewed  to  ensure  they  contain  a  common  understanding  of  the  scope, 
objectives,  roles,  and  relationships  that  are  required  for  the  project  to  be 
successful.  Many  of  these  plans  are  described  by  the  Plan  the  Process 
generic  practice. 

The  project  can  have  a  hierarchy  of  plans  (e.g.,  risk  mitigation  plans, 
transition  plans,  quality  assurance  plans,  configuration  management  plans). 
In  addition,  stakeholder  plans  (e.g.,  operational,  test,  support,  supplier 
plans)  should  be  reviewed  to  ensure  consistency  among  all  project 
participants.  Acquirer  review  of  plans  should  include  reviewing  cross¬ 
supplier  dependencies. 

Example  Work  Products 

1 .  Record  of  the  reviews  of  plans  that  affect  the  project 

SP  3.2  Reconcile  Work  and  Resource  Levels 

Adjust  the  project  plan  to  reconcile  available  and  estimated 
resources. 

To  establish  a  project  that  is  feasible,  obtain  commitment  from  relevant 
stakeholders  and  reconcile  differences  between  estimates  and  available 
resources.  Reconciliation  is  typically  accomplished  by  modifying  or 
deferring  requirements,  negotiating  more  resources,  finding  ways  to 
increase  productivity,  outsourcing,  adjusting  the  staff  skill  mix,  or  revising  all 
plans  that  affect  the  project  or  its  schedules. 

During  supplier  selection  and  negotiation  of  the  supplier  agreement,  the 
acquirer  reconciles  overall  project  work  and  resource  levels  based  on 
proposals  from  the  supplier.  Following  completion  of  the  supplier 
agreement,  the  acquirer  incorporates  supplier  plans  at  an  appropriate  level 
of  detail  into  the  project  plan  to  support  the  alignment  of  plans.  For 
example,  an  acquirer  can  incorporate  major  supplier  milestones, 
deliverables,  and  reviews. 

Example  Work  Products 

1 .  Revised  methods  and  corresponding  estimating  parameters  (e.g., 
better  tools,  the  use  of  off-the-shelf  components) 

2.  Renegotiated  budgets 

3.  Revised  schedules 
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4.  Revised  requirements  list 

5.  Renegotiated  stakeholder  agreements 

SP  3.3  Obtain  Plan  Commitment 

Obtain  commitment  from  relevant  stakeholders  responsible  for 
performing  and  supporting  plan  execution. 

Obtaining  commitment  involves  interaction  among  all  relevant  stakeholders, 
both  internal  and  external  to  the  project.  The  individual  or  group  making  a 
commitment  should  have  confidence  that  the  work  can  be  performed  within 
cost,  schedule,  and  performance  constraints.  Often,  a  provisional 
commitment  is  adequate  to  allow  the  effort  to  begin  and  to  permit  research 
to  be  performed  to  increase  confidence  to  the  appropriate  level  needed  to 
obtain  a  full  commitment. 

Example  Work  Products 

1 .  Documented  requests  for  commitments 

2.  Documented  commitments 

Subpractices 

1 .  Identify  needed  support  and  negotiate  commitments  with  relevant 
stakeholders. 

The  WBS  can  be  used  as  a  checklist  for  ensuring  that  commitments  are  obtained  for 
all  tasks. 

The  plan  for  stakeholder  interaction  should  identify  all  parties  from  whom  commitment 
should  be  obtained. 

2.  Document  all  organizational  commitments,  both  full  and  provisional, 
ensuring  the  appropriate  level  of  signatories. 

Commitments  should  be  documented  to  ensure  a  consistent  mutual  understanding 
and  for  project  tracking  and  maintenance.  Provisional  commitments  should  be 
accompanied  by  a  description  of  risks  associated  with  the  relationship. 

3.  Review  internal  commitments  with  senior  management  as  appropriate. 

4.  Review  external  commitments  with  senior  management  as  appropriate. 

Management  can  have  the  necessary  insight  and  authority  to  reduce  risks  associated 
with  external  commitments. 

5.  Identify  commitments  regarding  interfaces  between  project  elements 
and  other  projects  and  organizational  units  so  that  these  commitments 
can  be  monitored. 

Well-defined  interface  specifications  form  the  basis  for  commitments. 


300 


Project  Planning  (PP) 


CMMI  for  Acquisition,  Version  1.3 


PROCESS  AND  PRODUCT  QUALITY  ASSURANCE 

A  Support  Process  Area  at  Maturity  Level  2 


Purpose 


The  purpose  of  Process  and  Product  Quality  Assurance  (PPQA)  is  to 
provide  staff  and  management  with  objective  insight  into  processes  and 
associated  work  products. 


Introductory  Notes 


The  Process  and  Product  Quality  Assurance  process  area  involves  the 
following  activities: 

•  Objectively  evaluating  performed  processes  and  work  products  against 
applicable  process  descriptions,  standards,  and  procedures 

•  Identifying  and  documenting  noncompliance  issues 

•  Providing  feedback  to  project  staff  and  managers  on  the  results  of 
quality  assurance  activities 

•  Ensuring  that  noncompliance  issues  are  addressed 

The  Process  and  Product  Quality  Assurance  process  area  supports  the 
delivery  of  high-quality  products  by  providing  project  staff  and  managers  at 
all  levels  with  appropriate  visibility  into,  and  feedback  on,  processes  and 
associated  work  products  throughout  the  life  of  the  project. 

The  practices  in  the  Process  and  Product  Quality  Assurance  process  area 
ensure  that  planned  processes  are  implemented,  while  the  practices  in  the 
Acquisition  Verification  process  area  ensure  that  specified  requirements  are 
satisfied.  These  two  process  areas  can  on  occasion  address  the  same  work 
product  but  from  different  perspectives.  Projects  should  take  advantage  of 
the  overlap  to  minimize  duplication  of  effort  while  taking  care  to  maintain 
separate  perspectives. 

Objectivity  in  process  and  product  quality  assurance  evaluations  is  critical 
to  the  success  of  the  project.  (See  the  definition  of  “objectively  evaluate”  in 
the  glossary.)  Objectivity  is  achieved  by  both  independence  and  the  use  of 
criteria.  A  combination  of  methods  providing  evaluations  against  criteria  by 
those  who  do  not  produce  the  work  product  is  often  used.  Less  formal 
methods  can  be  used  to  provide  broad  day-to-day  coverage.  More  formal 
methods  can  be  used  periodically  to  assure  objectivity. 
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Examples  of  ways  to  perform  objective  evaluations  include  the  following: 

•  Formal  audits  by  organizationally  separate  quality  assurance  organizations 

•  Peer  reviews,  which  can  be  performed  at  various  levels  of  formality 

•  In-depth  review  of  work  at  the  place  it  is  performed  (i.e.,  desk  audits) 

•  Distributed  review  and  comment  of  work  products 

•  Process  checks  built  into  the  processes  such  as  a  fail-safe  for  processes  when  they  are 
done  incorrectly  (e.g.,  Poka-Yoke) 


Traditionally,  a  quality  assurance  group  that  is  independent  of  the  project 
provides  objectivity.  However,  another  approach  may  be  appropriate  in 
some  organizations  to  implement  the  process  and  product  quality 
assurance  role  without  that  kind  of  independence. 

f - 

j  For  example,  in  an  organization  with  an  open,  quality  oriented  culture,  the  process  and 
:  product  quality  assurance  role  can  be  performed,  partially  or  completely,  by  peers  and  the 
j  quality  assurance  function  can  be  embedded  in  the  process.  For  small  organizations,  this 
:  embedded  approach  might  be  the  most  feasible  approach. 


If  quality  assurance  is  embedded  in  the  process,  several  issues  should  be 
addressed  to  ensure  objectivity.  Everyone  performing  quality  assurance 
activities  should  be  trained  in  quality  assurance.  Those  who  perform  quality 
assurance  activities  for  a  work  product  should  be  separate  from  those  who 
are  directly  involved  in  developing  or  maintaining  the  work  product.  An 
independent  reporting  channel  to  the  appropriate  level  of  organizational 
management  should  be  available  so  that  noncompliance  issues  can  be 
escalated  as  necessary. 

For  example,  when  implementing  peer  reviews  as  an  objective  evaluation  method,  the 
following  issues  should  be  addressed: 

•  Members  are  trained  and  roles  are  assigned  for  people  attending  the  peer  reviews. 

•  A  member  of  the  peer  review  who  did  not  produce  this  work  product  is  assigned  to 
perform  the  quality  assurance  role. 

•  Checklists  based  on  process  descriptions,  standards,  and  procedures  are  available  to 
support  the  quality  assurance  activity. 

•  Noncompliance  issues  are  recorded  as  part  of  the  peer  review  report  and  are  tracked 
and  escalated  outside  the  project  when  necessary. 


Quality  assurance  should  begin  in  the  early  phases  of  a  project  to  establish 
plans,  processes,  standards,  and  procedures  that  will  add  value  to  the 
project  and  satisfy  the  requirements  of  the  project  and  organizational 
policies.  Those  who  perform  quality  assurance  activities  participate  in 
establishing  plans,  processes,  standards,  and  procedures  to  ensure  that 
they  fit  project  needs  and  that  they  will  be  usable  for  performing  quality 
assurance  evaluations.  In  addition,  processes  and  associated  work 
products  to  be  evaluated  during  the  project  are  designated.  This 
designation  can  be  based  on  sampling  or  on  objective  criteria  that  are 
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consistent  with  organizational  policies,  project  requirements,  and  project 
needs. 

When  noncompliance  issues  are  identified,  they  are  first  addressed  in  the 
project  and  resolved  there  if  possible.  Noncompliance  issues  that  cannot  be 
resolved  in  the  project  are  escalated  to  an  appropriate  level  of  management 
for  resolution. 

This  process  area  applies  to  evaluations  of  project  activities  and  work 
products,  and  to  organizational  (e.g.,  process  group,  organizational  training) 
activities  and  work  products.  For  organizational  activities  and  work 
products,  the  term  “project”  should  be  appropriately  interpreted. 


Related  Process  Areas 

Refer  to  the  Acquisition  Verification  process  area  for  more  information 
about  ensuring  that  selected  work  products  meet  their  specified 
requirements. 

Specific  Goal  and  Practice  Summary 

SG  1  Objectively  Evaluate  Processes  and  Work  Products 
SP  1.1  Objectively  Evaluate  Processes 
SP  1 .2  Objectively  Evaluate  Work  Products 
SG  2  Provide  Objective  Insight 

SP  2.1  Communicate  and  Resolve  Noncompliance  Issues 

SP  2.2  Establish  Records 

Specific  Practices  by  Goal 


SG  1  Objectively  Evaluate  Processes  and  Work  Products 

Adherence  of  the  performed  process  and  associated  work  products  to 
applicable  process  descriptions,  standards,  and  procedures  is  objectively 
evaluated. 


SP  1.1  Objectively  Evaluate  Processes 

Objectively  evaluate  selected  performed  processes  against 
applicable  process  descriptions,  standards,  and  procedures. 

Objectivity  in  quality  assurance  evaluations  is  critical  to  the  success  of  the 
project.  A  description  of  the  quality  assurance  reporting  chain  and  how  it 
ensures  objectivity  should  be  defined. 

Example  Work  Products 

1 .  Evaluation  reports 

2.  Noncompliance  reports 

3.  Corrective  actions 
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Subpractices 

1 .  Promote  an  environment  (created  as  part  of  project  management)  that 
encourages  staff  participation  in  identifying  and  reporting  quality 
issues. 

2.  Establish  and  maintain  clearly  stated  criteria  for  evaluations. 

The  intent  of  this  subpractice  is  to  provide  criteria,  based  on  business  needs,  such  as 
the  following: 

•  What  will  be  evaluated 

•  When  or  how  often  a  process  will  be  evaluated 

•  How  the  evaluation  will  be  conducted 

•  Who  must  be  involved  in  the  evaluation 

3.  Use  the  stated  criteria  to  evaluate  selected  performed  processes  for 
adherence  to  process  descriptions,  standards,  and  procedures. 

4.  Identify  each  noncompliance  found  during  the  evaluation. 

5.  Identify  lessons  learned  that  could  improve  processes. 

SP  1 .2  Objectively  Evaluate  Work  Products 

Objectively  evaluate  selected  work  products  against  applicable 
process  descriptions,  standards,  and  procedures. 


Example  Work  Products 

1 .  Evaluation  reports 

2.  Noncompliance  reports 

3.  Corrective  actions 

Subpractices 

1 .  Select  work  products  to  be  evaluated  based  on  documented  sampling 
criteria  if  sampling  is  used. 

Work  products  can  include  services  produced  by  a  process  whether  the  recipient  of 
the  service  is  internal  or  external  to  the  project  or  organization. 

2.  Establish  and  maintain  clearly  stated  criteria  for  the  evaluation  of 
selected  work  products. 

The  intent  of  this  subpractice  is  to  provide  criteria,  based  on  business  needs,  such  as 
the  following: 

•  What  will  be  evaluated  during  the  evaluation  of  a  work  product 

•  When  or  how  often  a  work  product  will  be  evaluated 

•  How  the  evaluation  will  be  conducted 

•  Who  must  be  involved  in  the  evaluation 

3.  Use  the  stated  criteria  during  evaluations  of  selected  work  products. 

4.  Evaluate  selected  work  products  at  selected  times. 
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Examples  of  when  work  products  can  be  evaluated  against  process  descriptions, 
standards,  or  procedures  include  the  following: 

•  Before  delivery  to  the  customer 

•  During  delivery  to  the  customer 

•  Incrementally,  when  it  is  appropriate 


5.  Identify  each  case  of  noncompliance  found  during  evaluations. 

6.  Identify  lessons  learned  that  could  improve  processes. 

SG  2 _ Provide  Objective  Insight _ 

Noncompliance  issues  are  objectively  tracked  and  communicated,  and 
resolution  is  ensured. 


SP  2.1  Communicate  and  Resolve  Noncompliance  Issues 

Communicate  quality  issues  and  ensure  the  resolution  of 
noncompliance  issues  with  the  staff  and  managers. 

Noncompliance  issues  are  problems  identified  in  evaluations  that  reflect  a 
lack  of  adherence  to  applicable  standards,  process  descriptions,  or 
procedures.  The  status  of  noncompliance  issues  provides  an  indication  of 
quality  trends.  Quality  issues  include  noncompliance  issues  and  trend 
analysis  results. 

When  noncompliance  issues  cannot  be  resolved  in  the  project,  use 
established  escalation  mechanisms  to  ensure  that  the  appropriate  level  of 
management  can  resolve  the  issue.  Track  noncompliance  issues  to 
resolution. 

Example  Work  Products 

1 .  Corrective  action  reports 

2.  Evaluation  reports 

3.  Quality  trends 

Subpractices 

1 .  Resolve  each  noncompliance  with  the  appropriate  members  of  the  staff 
if  possible. 

2.  Document  noncompliance  issues  when  they  cannot  be  resolved  in  the 
project. 

i  Examples  of  ways  to  resolve  noncompliance  in  the  project  include  the  following: 

:  •  Fixing  the  noncompliance 

j  •  Changing  the  process  descriptions,  standards,  or  procedures  that  were  violated 
j  •  Obtaining  a  waiver  to  cover  the  noncompliance 

3.  Escalate  noncompliance  issues  that  cannot  be  resolved  in  the  project 
to  the  appropriate  level  of  management  designated  to  receive  and  act 
on  noncompliance  issues. 
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4.  Analyze  noncompliance  issues  to  see  if  there  are  quality  trends  that 
can  be  identified  and  addressed. 

5.  Ensure  that  relevant  stakeholders  are  aware  of  results  of  evaluations 
and  quality  trends  in  a  timely  manner. 

6.  Periodically  review  open  noncompliance  issues  and  trends  with  the 
manager  designated  to  receive  and  act  on  noncompliance  issues. 

7.  Track  noncompliance  issues  to  resolution. 

SP  2.2  Establish  Records 

Establish  and  maintain  records  of  quality  assurance  activities. 


Example  Work  Products 

1 .  Evaluation  logs 

2.  Quality  assurance  reports 

3.  Status  reports  of  corrective  actions 

4.  Reports  of  quality  trends 

Subpractices 

1 .  Record  process  and  product  quality  assurance  activities  in  sufficient 
detail  so  that  status  and  results  are  known. 

2.  Revise  the  status  and  history  of  quality  assurance  activities  as 
necessary. 
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QUANTITATIVE  PROJECT  MANAGEMENT 

A  Project  Management  Process  Area  at  Maturity  Level  4 


Purpose 


The  purpose  of  Quantitative  Project  Management  (QPM)  is  to  quantitatively 
manage  the  project  to  achieve  the  project’s  established  quality  and  process 
performance  objectives. 


Introductory  Notes 


The  Quantitative  Project  Management  process  area  involves  the  following 
activities: 

•  Establishing  and  maintaining  the  project’s  quality  and  process 
performance  objectives 

•  Composing  a  defined  process  for  the  project  to  help  to  achieve  the 
project's  quality  and  process  performance  objectives 

•  Selecting  subprocesses  and  attributes  critical  to  understanding 
performance  and  that  help  to  achieve  the  project’s  quality  and  process 
performance  objectives 

•  Selecting  measures  and  analytic  techniques  to  be  used  in  quantitative 
management 

•  Monitoring  the  performance  of  selected  subprocesses  using  statistical 
and  other  quantitative  techniques 

•  Managing  the  project  using  statistical  and  other  quantitative  techniques 
to  determine  whether  or  not  the  project’s  objectives  for  quality  and 
process  performance  are  being  satisfied 

•  Performing  root  cause  analysis  of  selected  issues  to  address 
deficiencies  in  achieving  the  project’s  quality  and  process  performance 
objectives 

Organizational  process  assets  used  to  achieve  high  maturity,  including 
quality  and  process  performance  objectives,  selected  processes,  measures, 
baselines,  and  models,  are  established  using  organizational  process 
performance  processes  and  used  in  quantitative  project  management 
processes.  The  project  can  use  organizational  process  performance 
processes  to  define  additional  objectives,  measures,  baselines,  and  models 
as  needed  to  effectively  analyze  and  manage  performance.  The  measures, 
measurements,  and  other  data  resulting  from  quantitative  project 
management  processes  are  incorporated  into  the  organizational  process 
assets.  In  this  way,  the  organization  and  its  projects  derive  benefit  from 
assets  improved  through  use. 

The  project’s  defined  process  is  a  set  of  interrelated  subprocesses  that  form 
an  integrated  and  coherent  process  for  the  project.  The  Integrated  Project 
Management  practices  describe  establishing  the  project’s  defined  process 
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by  selecting  and  tailoring  processes  from  the  organization’s  set  of  standard 
processes.  (See  the  definition  of  “defined  process”  in  the  glossary.) 

Quantitative  Project  Management  practices,  unlike  Integrated  Project 
Management  practices,  help  you  to  develop  a  quantitative  understanding  of 
the  expected  performance  of  processes  or  subprocesses.  This 
understanding  is  used  as  a  basis  for  establishing  the  project’s  defined 
process  by  evaluating  alternative  processes  or  subprocesses  for  the  project 
and  selecting  the  ones  that  will  best  achieve  the  quality  and  process 
performance  objectives. 

Establishing  effective  relationships  with  suppliers  is  also  important  to  the 
successful  implementation  of  this  process  area.  Establishing  effective 
relationships  can  involve  establishing  quality  and  process  performance 
objectives  for  suppliers,  determining  the  measures  and  analytic  techniques 
to  be  used  to  gain  insight  into  supplier  progress  and  performance,  and 
monitoring  progress  toward  achieving  those  objectives. 

The  acquirer  uses  statistical  and  other  quantitative  techniques  to  both 
manage  its  work  and  to  gain  insight  into  supplier  work  and  work  products. 

An  essential  element  of  quantitative  management  is  having  confidence  in 
predictions  (i.e.,  the  ability  to  accurately  predict  the  extent  to  which  the 
project  can  fulfill  its  quality  and  process  performance  objectives). 
Subprocesses  to  be  managed  through  the  use  of  statistical  and  other 
quantitative  techniques  are  chosen  based  on  the  needs  for  predictable 
process  performance. 

Another  essential  element  of  quantitative  management  is  understanding  the 
nature  and  extent  of  the  variation  experienced  in  process  performance  and 
recognizing  when  the  project’s  actual  performance  may  not  be  adequate  to 
achieve  the  project’s  quality  and  process  performance  objectives. 

Thus,  quantitative  management  includes  statistical  thinking  and  the  correct 
use  of  a  variety  of  statistical  techniques.  (See  the  definition  of  “quantitative 
management”  in  the  glossary.) 

Statistical  and  other  quantitative  techniques  are  used  to  develop  an 
understanding  of  the  actual  performance  or  to  predict  the  performance  of 
processes.  Such  techniques  can  be  applied  at  multiple  levels,  from  a  focus 
on  individual  subprocesses  to  analyses  that  span  lifecycle  phases,  projects, 
and  support  functions.  Non-statistical  techniques  provide  a  less  rigorous  but 
still  useful  set  of  approaches  that  together  with  statistical  techniques  help 
the  project  to  understand  whether  or  not  quality  and  process  performance 
objectives  are  being  satisfied  and  to  identify  any  needed  corrective  actions. 

This  process  area  applies  to  managing  a  project.  Applying  these  concepts 
to  managing  other  groups  and  functions  can  help  to  link  different  aspects  of 
performance  in  the  organization  to  provide  a  basis  for  balancing  and 
reconciling  competing  priorities  to  address  a  broader  set  of  business 
objectives. 
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Examples  of  other  groups  and  functions  that  could  benefit  from  using  this  process  area 
include  the  following: 

•  Quality  assurance  or  quality  control  functions 

•  Process  definition  and  improvement 

•  Internal  research  and  development  functions 

•  Risk  identification  and  management  functions 

•  Technology  scouting  functions 

•  Market  research 

•  Customer  satisfaction  assessment 

•  Problem  tracking  and  reporting 


Related  Process  Areas 


Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  supplier  agreements. 

Refer  to  the  Causal  Analysis  and  Resolution  process  area  for  more 
information  about  identifying  causes  of  selected  outcomes  and  taking  action 
to  improve  process  performance. 

Refer  to  the  Integrated  Project  Management  process  area  for  more 
information  about  establishing  the  project’s  defined  process. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  aligning  measurement  and  analysis  activities  and  providing 
measurement  results. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

Refer  to  the  Organizational  Performance  Management  process  area  for 
more  information  about  proactively  managing  the  organization’s 
performance  to  meet  its  business  objectives. 

Refer  to  the  Organizational  Process  Performance  process  area  for  more 
information  about  establishing  and  maintaining  a  quantitative  understanding 
of  the  performance  of  selected  processes  in  the  organization’s  set  of 
standard  processes  in  support  of  achieving  quality  and  process 
performance  objectives,  and  providing  process  performance  data, 
baselines,  and  models  to  quantitatively  manage  the  organization’s  projects. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  providing  an  understanding  of  the  project’s  progress  so 
that  appropriate  corrective  actions  can  be  taken  when  the  project’s 
performance  deviates  significantly  from  the  plan. 
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Specific  Goal  and  Practice  Summary 

SG  1  Prepare  for  Quantitative  Management 

SP  1 .1  Establish  the  Project's  Objectives 
SP  1 .2  Compose  the  Defined  Process 
SP  1 .3  Select  Subprocesses  and  Attributes 
SP  1 .4  Select  Measures  and  Analytic  Techniques 

SG  2  Quantitatively  Manage  the  Project 

SP  2.1  Monitor  the  Performance  of  Selected  Subprocesses 
SP  2.2  Manage  Project  Performance 

SP  2.3  Perform  Root  Cause  Analysis 

Specific  Practices  by  Goal 


SG  1 _ Prepare  for  Quantitative  Management _ 

Preparation  for  quantitative  management  is  conducted. 

Preparation  activities  include  establishing  quantitative  objectives  for  the 
project,  composing  a  defined  process  for  the  project  that  can  help  to 
achieve  those  objectives,  selecting  subprocesses  and  attributes  critical  to 
understanding  performance  and  achieving  the  objectives,  and  selecting 
measures  and  analytic  techniques  that  support  quantitative  management. 

These  activities  may  need  to  be  repeated  when  needs  and  priorities 
change,  when  there  is  an  improved  understanding  of  process  performance, 
or  as  part  of  risk  mitigation  or  corrective  action. 

SP  1.1  Establish  the  Project’s  Objectives 

Establish  and  maintain  the  project’s  quality  and  process 
performance  objectives. 

When  establishing  the  project’s  quality  and  process  performance 
objectives,  think  about  the  processes  that  will  be  included  in  the  project’s 
defined  process  and  what  the  historical  data  indicate  regarding  their 
process  performance.  These  considerations,  along  with  others  such  as 
technical  capability,  will  help  in  establishing  realistic  objectives  for  the 
project. 

The  project’s  objectives  for  quality  and  process  performance  are 
established  and  negotiated  at  an  appropriate  level  of  detail  (e.g.,  for 
individual  product  components,  subprocesses,  project  teams)  to  permit  an 
overall  evaluation  of  the  objectives  and  risks  at  the  project  level.  As  the 
project  progresses,  project  objectives  can  be  updated  as  the  project’s 
actual  performance  becomes  known  and  more  predictable,  and  to  reflect 
changing  needs  and  priorities  of  relevant  stakeholders. 
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The  acquirer  establishes  the  project’s  quality  and  process  performance 
objectives  based  on  objectives  of  the  organization,  the  customer,  and  other 
relevant  stakeholders.  The  acquirer  can  also  establish  quality  and  process 
performance  objectives  for  supplier  deliverables.  These  quantitative  quality 
and  process  performance  objectives  for  the  supplier  are  documented  in  the 
supplier  agreement.  The  acquirer  typically  expects  the  supplier  to  execute 
its  processes  and  apply  its  process  performance  models  toward  achieving 
these  objectives. 

Example  Work  Products 

1 .  The  project’s  quality  and  process  performance  objectives 

2.  Assessment  of  the  risk  of  not  achieving  the  project’s  objectives 

Subpractices 

1 .  Review  the  organization's  objectives  for  quality  and  process 
performance. 

This  review  ensures  that  project  staff  understand  the  broader  business  context  in 
which  the  project  operates.  The  project’s  objectives  for  quality  and  process 
performance  are  developed  in  the  context  of  these  overarching  organizational 
objectives. 

Refer  to  the  Organizational  Process  Performance  process  area  for 
more  information  about  establishing  quality  and  process  performance 
objectives. 

2.  Identify  the  quality  and  process  performance  needs  and  priorities  of  the 
customer,  suppliers,  end  users,  and  other  relevant  stakeholders. 

Typically,  the  identification  of  relevant  stakeholders’  needs  will  begin  early  (e.g.,  during 
development  of  the  acquisition  strategy).  Needs  are  further  elicited,  analyzed,  refined, 
prioritized,  and  balanced  during  acquisition  requirements  development. 

i  Examples  of  quality  and  process  performance  attributes  for  which  needs  and  priorities 
:  might  be  identified  include  the  following: 

i  •  Duration 
j  •  Predictability 
|  •  Reliability 
:  •  Maintainability 
:  •  Usability 
i  •  Timeliness 
:  •  Functionality 
:  •  Accuracy 

3.  Define  and  document  measurable  quality  and  process  performance 
objectives  for  the  project. 

Defining  and  documenting  objectives  for  the  project  involve  the  following: 

•  Incorporating  appropriate  organizational  quality  and  process  performance 
objectives 
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•  Writing  objectives  that  reflect  the  quality  and  process  performance  needs  and 
priorities  of  the  customer,  end  users,  and  other  relevant  stakeholders 

•  Determining  how  each  objective  will  be  achieved 

•  Reviewing  the  objectives  to  ensure  they  are  sufficiently  specific,  measurable, 
attainable,  relevant,  and  time-bound 

i  Examples  of  measurable  quality  attributes  include  the  following: 
i  •  Mean  time  between  failures 

:  •  Number  and  severity  of  customer  complaints  concerning  the  provided  service 

:  •  Critical  resource  utilization 

j_  •  Number  and  severity  of  defects  in  the  released  product 

j  Examples  of  measurable  process  performance  attributes  include  the  following: 
j  •  Cycle  time 
:  •  Percentage  of  rework  time 

i  •  Percentage  of  defects  removed  by  product  verification  activities  (perhaps  by  type 
i  of  verification,  such  as  peer  reviews  and  testing) 

:  •  Defect  escape  rates 


4.  Derive  interim  objectives  to  monitor  progress  toward  achieving  the 
project’s  objectives. 

Interim  objectives  can  be  established  for  attributes  of  selected  lifecycle  phases, 
milestones,  work  products,  and  subprocesses. 

Since  process  performance  models  characterize  relationships  among  product  and 
process  attributes,  these  models  can  be  used  to  help  derive  interim  objectives  that 
guide  the  project  toward  achieving  its  objectives. 

5.  Determine  the  risk  of  not  achieving  the  project’s  quality  and  process 
performance  objectives. 

The  risk  is  a  function  of  the  established  objectives,  the  product  architecture,  the 
project’s  defined  process,  availability  of  needed  knowledge  and  skills,  etc.  Process 
performance  baselines  and  models  can  be  used  to  evaluate  the  likelihood  of  achieving 
a  set  of  objectives  and  provide  guidance  in  negotiating  objectives  and  commitments. 
The  assessment  of  risk  can  involve  various  project  stakeholders  and  can  be  conducted 
as  part  of  the  conflict  resolution  described  in  the  next  subpractice. 

6.  Resolve  conflicts  among  the  project’s  quality  and  process  performance 
objectives  (e.g.,  if  one  objective  cannot  be  achieved  without 
compromising  another). 

Process  performance  models  can  help  to  identify  conflicts  and  help  to  ensure  that  the 
resolution  of  conflicts  does  not  introduce  new  conflicts  or  risks. 

Resolving  conflicts  involves  the  following  activities: 

•  Setting  relative  priorities  for  objectives 

•  Considering  alternative  objectives  in  light  of  long-term  business  strategies  as  well 
as  short-term  needs 
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•  Involving  the  customer,  end  users,  senior  management,  project  management,  and 
other  relevant  stakeholders  in  tradeoff  decisions 

•  Revising  objectives  as  necessary  to  reflect  results  of  conflict  resolution 

7.  Establish  traceability  to  the  project’s  quality  and  process  performance 
objectives  from  their  sources. 

i  Examples  of  sources  of  objectives  include  the  following: 
i  •  Requirements 

:  •  The  organization’s  quality  and  process  performance  objectives 
i  •  The  customer’s  quality  and  process  performance  objectives 
i  •  Business  objectives 

j  •  Discussions  with  customers  and  potential  customers 
j  •  Market  surveys 
:  •  Product  Architecture 

i  An  example  of  a  method  to  identify  and  trace  these  needs  and  priorities  is  Quality 
i_  Function  Deployment  (QFD). 

8.  Define  and  negotiate  quality  and  process  performance  objectives  for 
suppliers. 

Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  supplier  agreements. 

9.  Revise  the  project’s  quality  and  process  performance  objectives  as 
necessary. 

SP  1.2  Compose  the  Defined  Process 

Using  statistical  and  other  quantitative  techniques,  compose  a 
defined  process  that  enables  the  project  to  achieve  its  quality  and 
process  performance  objectives. 

Refer  to  the  Integrated  Project  Management  process  area  for  more 
information  about  establishing  the  project’s  defined  process. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

Refer  to  the  Organizational  Process  Performance  process  area  for  more 
information  about  establishing  performance  baselines  and  models. 

Composing  the  project’s  defined  process  goes  beyond  the  process 
selection  and  tailoring  described  in  the  Integrated  Project  Management 
process  area.  It  involves  identifying  alternatives  to  one  or  more  processes 
or  subprocesses,  performing  quantitative  analysis  of  performance  and 
selecting  the  alternatives  that  are  best  able  to  help  the  project  to  achieve  its 
quality  and  process  performance  objectives. 

These  subprocesses  can  include  activities  used  for  interacting  with  a 
supplier  (e.g.,  negotiating  a  supplier  agreement,  conducting  supplier 
reviews). 
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Example  Work  Products 

1 .  Criteria  used  to  evaluate  alternatives  for  the  project 

2.  Alternative  subprocesses 

3.  Subprocesses  to  be  included  in  the  project’s  defined  process 

4.  Assessment  of  risk  of  not  achieving  the  project’s  objectives 

Subpractices 

1 .  Establish  the  criteria  to  use  in  evaluating  process  alternatives  for  the 
project. 

i - - 

|  Criteria  can  be  based  on  the  following: 

|  •  Quality  and  process  performance  objectives 

|  •  Availability  of  process  performance  data  and  the  relevance  of  the  data  to 
j  evaluating  an  alternative 

i  •  Familiarity  with  an  alternative  or  with  alternatives  similar  in  composition 

i  •  Existence  of  process  performance  models  that  can  be  used  in  evaluating  an 
i  alternative 

i  •  Product  line  standards 
j  •  Standard  services  and  service  levels 
j  •  Project  lifecycle  models 
|  •  Stakeholder  requirements 
:  •  Laws  and  regulations 


2.  Identify  alternative  processes  and  subprocesses  for  the  project. 
Identifying  alternatives  can  include  one  or  more  of  the  following: 

•  Analyzing  organizational  process  performance  baselines  to  identify  candidate 
subprocesses  that  would  help  achieve  the  project’s  quality  and  process 
performance  objectives 

•  Identifying  subprocesses  from  the  organization’s  set  of  standard  processes  as  well 
as  tailored  processes  in  the  process  asset  library  that  can  help  to  achieve  the 
objectives 

•  Identifying  processes  from  external  sources  (e.g.,  such  as  other  organizations, 
professional  conferences,  academic  research) 

•  Adjusting  the  level  or  depth  of  intensity  with  which  a  subprocess  is  applied  (as 
described  in  further  detail  in  a  subpractice  that  follows) 

Adjusting  the  level  or  depth  of  intensity  with  which  the  subprocesses  are  applied  can 
involve  the  following  choices: 

•  Number  and  type  of  peer  reviews  to  be  held  and  when 

•  Amount  of  effort  or  calendar  time  devoted  to  particular  tasks 

•  Number  and  selection  of  people  involved 

•  Skill  level  requirements  for  performing  specific  tasks 

•  Selective  application  of  specialized  construction  or  verification  techniques 
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•  Reuse  decisions  and  associated  risk  mitigation  strategies 

•  The  product  and  process  attributes  to  be  measured 

•  Sampling  rate  for  management  data 

Refer  to  the  Integrated  Project  Management  process  area  for  more 
information  about  using  organizational  process  assets  for  planning 
project  activities. 

3.  Analyze  the  interaction  of  alternative  subprocesses  to  understand 
relationships  among  the  subprocesses,  including  their  attributes. 

An  analysis  of  the  interaction  will  provide  insight  into  the  relative  strengths  and 
weaknesses  of  particular  alternatives.  This  analysis  can  be  supported  by  a  calibration 
of  the  organization’s  process  performance  models  with  process  performance  data 
(e.g.,  as  characterized  in  process  performance  baselines). 

Additional  modeling  may  be  needed  if  existing  process  performance  models  cannot 
address  significant  relationships  among  the  alternative  subprocesses  under 
consideration  and  there  is  high  risk  of  not  achieving  objectives. 

4.  Evaluate  alternative  subprocesses  against  the  criteria. 

Use  historical  data,  process  performance  baselines,  and  process  performance  models 
as  appropriate  to  assist  in  evaluating  alternatives  against  the  criteria.  These 
evaluations  can  include  use  of  a  sensitivity  analysis  particularly  in  high  risk  situations. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  evaluating  alternatives. 

5.  Select  the  alternative  subprocesses  that  best  meet  the  criteria. 

It  may  be  necessary  to  iterate  through  the  activities  described  in  the  previous 
subpractices  several  times  before  confidence  is  achieved  that  the  best  available 
alternatives  have  been  identified. 

6.  Evaluate  the  risk  of  not  achieving  the  project’s  quality  and  process 
performance  objectives. 

An  analysis  of  risk  associated  with  the  selected  alternative  defined  process  can  lead  to 
identifying  new  alternatives  to  be  evaluated,  as  well  as  areas  requiring  more 
management  attention. 

Refer  to  the  Risk  Management  process  area  for  more  information 
about  identifying  and  analyzing  risks. 

SP  1.3  Select  Subprocesses  and  Attributes 

Select  subprocesses  and  attributes  critical  to  evaluating 
performance  and  that  help  to  achieve  the  project’s  quality  and 
process  performance  objectives. 

Some  subprocesses  are  critical  because  their  performance  significantly 
influences  or  contributes  to  achieving  the  project’s  objectives.  These 
subprocesses  may  be  good  candidates  for  monitoring  and  control  using 
statistical  and  other  quantitative  techniques  as  described  in  the  first  specific 
practice  of  the  second  specific  goal. 
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Also,  some  attributes  of  these  subprocesses  can  serve  as  leading 
indicators  of  the  process  performance  to  expect  of  subprocesses  that  are 
further  downstream  and  can  be  used  to  assess  the  risk  of  not  achieving  the 
project’s  objectives  (e.g.,  by  using  process  performance  models). 

Subprocesses  and  attributes  that  play  such  critical  roles  may  have  already 
been  identified  as  part  of  the  analyses  described  in  the  previous  specific 
practice. 

For  small  projects,  and  other  circumstances  in  which  subprocess  data  may 
not  be  generated  frequently  enough  in  the  project  to  support  a  sufficiently 
sensitive  statistical  inference,  it  may  still  be  possible  to  understand 
performance  by  examining  process  performance  across  similar  iterations, 
teams,  or  projects. 

Example  Work  Products 

1 .  Criteria  used  to  select  subprocesses  that  are  key  contributors  to 
achieving  the  project’s  objectives 

2.  Selected  subprocesses 

3.  Attributes  of  selected  subprocesses  that  help  in  predicting  future 
project  performance 

Subpractices 

1 .  Analyze  how  subprocesses,  their  attributes,  other  factors,  and  project 
performance  results  relate  to  each  other. 

A  root  cause  analysis,  sensitivity  analysis,  or  process  performance  model  can  help  to 
identify  the  subprocesses  and  attributes  that  most  contribute  to  achieving  particular 
performance  results  (and  variation  in  performance  results)  or  that  are  useful  indicators 
of  future  achievement  of  performance  results. 

Refer  to  the  Causal  Analysis  and  Resolution  process  area  for  more 
information  about  determining  causes  of  selected  outcomes. 

2.  Identify  criteria  to  be  used  in  selecting  subprocesses  that  are  key 
contributors  to  achieving  the  project’s  quality  and  process  performance 
objectives. 

:  Examples  of  criteria  used  to  select  subprocesses  include  the  following: 

i  •  There  is  a  strong  correlation  with  performance  results  that  are  addressed  in  the 
:  project’s  objectives. 

:  •  Stable  performance  of  the  subprocess  is  important. 

:  •  Poor  subprocess  performance  is  associated  with  major  risks  to  the  project. 

i  •  One  or  more  attributes  of  the  subprocess  serve  as  key  inputs  to  process 
j  performance  models  used  in  the  project. 

|  •  The  subprocess  will  be  executed  frequently  enough  to  provide  sufficient  data  for 
I  analysis. 


3.  Select  subprocesses  using  the  identified  criteria. 

Historical  data,  process  performance  models,  and  process  performance  baselines  can 
help  in  evaluating  candidate  subprocesses  against  selection  criteria. 
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Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  evaluating  alternatives. 

4.  Identify  product  and  process  attributes  to  be  monitored. 

These  attributes  may  have  been  identified  as  part  of  performing  the  previous 
subpractices. 

Attributes  that  provide  insight  into  current  or  future  subprocess  performance  are 
candidates  for  monitoring,  whether  or  not  the  associated  subprocesses  are  under  the 
control  of  the  project.  Also,  some  of  these  same  attributes  may  serve  other  roles,  (e.g., 
to  help  in  monitoring  project  progress  and  performance  as  described  in  Project 
Monitoring  and  Control  [PMC]). 

r - ■ 

|  Examples  of  product  and  process  attributes  include  the  following: 

■  •  Effort  consumed  to  perform  the  subprocess 

|  •  The  rate  at  which  the  subprocess  is  performed 

:  •  Cycle  time  for  process  elements  that  make  up  the  subprocess 

i  •  Resource  or  materials  consumed  as  input  to  the  subprocess 

i  •  Skill  level  of  the  staff  member  performing  the  subprocess 

:  •  Quality  of  the  work  environment  used  to  perform  the  subprocess 

:  •  Volume  of  outputs  of  the  subprocess  (e.g.,  intermediate  work  products) 

:  •  Quality  attributes  of  outputs  of  the  subprocess  (e.g.,  reliability,  testability) 


SP  1.4  Select  Measures  and  Analytic  Techniques 

Select  measures  and  analytic  techniques  to  be  used  in  quantitative 
management. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  aligning  measurement  and  analysis  activities  and  providing 
measurement  results. 

Example  Work  Products 

1 .  Definitions  of  measures  and  analytic  techniques  to  be  used  in 
quantitative  management 

2.  Traceability  of  measures  back  to  the  project’s  quality  and  process 
performance  objectives 

3.  Quality  and  process  performance  objectives  for  selected  subprocesses 
and  their  attributes 

4.  Process  performance  baselines  and  models  for  use  by  the  project 

Subpractices 

1 .  Identify  common  measures  from  the  organizational  process  assets  that 
support  quantitative  management. 

Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 


Quantitative  Project  Management  (QPM) 


317 


CMMI  for  Acquisition,  Version  1.3 


Refer  to  the  Organizational  Process  Performance  process  area  for 
more  information  about  establishing  performance  baselines  and 
models. 

Product  lines,  standard  services,  and  service  levels  or  other  stratification  criteria  can 
categorize  common  measures. 

2.  Identify  additional  measures  that  may  be  needed  to  cover  critical 
product  and  process  attributes  of  the  selected  subprocesses. 

In  some  cases,  measures  can  be  research  oriented.  Such  measures  should  be 
explicitly  identified. 

3.  Identify  the  measures  to  be  used  in  managing  subprocesses. 

When  selecting  measures,  keep  the  following  considerations  in  mind: 

•  Measures  that  aggregate  data  from  multiple  sources  (e.g.,  different 
processes,  input  sources,  environments)  or  over  time  (e.g.,  at  a  phase  level) 
can  mask  underlying  problems,  making  problem  identification  and  resolution 
difficult. 

•  For  short-term  projects,  it  may  be  necessary  to  aggregate  data  across  similar 
instances  of  a  process  to  enable  analysis  of  its  process  performance  while 
continuing  to  use  the  unaggregated  data  in  support  of  individual  projects. 

•  Selection  should  not  be  limited  to  progress  or  performance  measures  only. 
“Analysis  measures”  (e.g.,  inspection  preparation  rates,  staff  member  skill 
levels,  path  coverage  in  testing)  may  provide  better  insight  into  process 
performance. 

4.  Specify  the  operational  definitions  of  measures,  their  collection  points 
in  subprocesses,  and  how  the  integrity  of  measures  will  be  determined. 

5.  Analyze  the  relationship  of  identified  measures  to  the  project  quality 
and  process  performance  objectives  and  derive  subprocess  quality  and 
process  performance  objectives  that  state  targets  (e.g.,  thresholds, 
ranges)  to  be  met  for  each  measured  attribute  of  each  selected 
subprocess. 

j  Examples  of  derived  subprocess  quality  and  process  performance  objectives  include 
j  the  following: 

i  •  Maintain  a  code  review  rate  between  75  to  1 00  lines  of  code  per  hour 
:  •  Keep  requirements  gathering  sessions  to  under  three  hours 
:  •  Keep  test  rate  over  a  specified  number  of  test  cases  per  day 
i  •  Maintain  rework  levels  below  a  specified  percent 
j  •  Maintain  productivity  in  generating  use  cases  per  day 
j  •  Keep  design  complexity  (fan-out  rate)  below  a  specified  threshold 

6.  Identify  the  statistical  and  other  quantitative  techniques  to  be  used  in 
quantitative  management. 

In  quantitative  management,  the  process  performance  of  selected  subprocesses  is 
analyzed  using  statistical  and  other  quantitative  techniques  that  help  to  characterize 
subprocess  variation,  identify  when  statistically  unexpected  behavior  occurs,  recognize 
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when  variation  is  excessive,  and  investigate  why.  Examples  of  statistical  techniques 
that  can  be  used  in  the  analysis  of  process  performance  include  statistical  process 
control  charts,  regression  analysis,  analysis  of  variance,  and  time  series  analysis. 

The  project  can  benefit  from  analyzing  the  performance  of  subprocesses  not  selected 
for  their  impact  on  project  performance.  Statistical  and  other  quantitative  techniques 
can  be  identified  to  address  these  subprocesses  as  well. 

Statistical  and  other  quantitative  techniques  sometimes  involve  the  use  of  graphical 
displays  that  help  visualize  associations  among  the  data  and  results  of  analyses.  Such 
graphical  displays  can  help  visualize  process  performance  and  variation  over  time  (i.e., 
trends),  identify  problems  or  opportunities,  and  evaluate  the  effects  of  particular 
factors. 

Examples  of  graphical  displays  include  the  following: 

•  Scatterplots 

•  Histograms 

•  Box  and  whiskers  plots 

•  Run  charts 

•  Ishikawa  diagrams 

Examples  of  other  techniques  used  to  analyze  process  performance  include  the 
following: 

•  Tally  sheets 

•  Classification  schemas  (e.g.,  Orthogonal  Defect  Classification) 


7.  Determine  what  process  performance  baselines  and  models  may  be 
needed  to  support  identified  analyses. 

In  some  situations,  the  set  of  baselines  and  models  provided  as  described  in 
Organizational  Process  Performance  may  be  inadequate  to  support  quantitative 
project  management.  This  situation  can  happen  when  the  objectives,  processes, 
stakeholders,  skill  levels,  or  environment  for  the  project  are  different  from  other 
projects  for  which  baselines  and  models  were  established. 

As  the  project  progresses,  data  from  the  project  can  serve  as  a  more  representative 
data  set  for  establishing  missing  or  a  project  specific  set  of  process  performance 
baselines  and  models. 

Hypothesis  testing  comparing  project  data  to  prior  historical  data  can  confirm  the  need 
to  establish  additional  baselines  and  models  specific  to  the  project. 

8.  Instrument  the  organizational  or  project  support  environment  to  support 
collection,  derivation,  and  analysis  of  measures. 

This  instrumentation  is  based  on  the  following: 

•  Description  of  the  organization’s  set  of  standard  processes 

•  Description  of  the  project’s  defined  process 

•  Capabilities  of  the  organizational  or  project  support  environment 

9.  Revise  measures  and  statistical  analysis  techniques  as  necessary. 
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SG  2 _ Quantitatively  Manage  the  Project _ 

The  project  is  quantitatively  managed. 

Quantitatively  managing  the  project  involves  the  use  of  statistical  and  other 
quantitative  techniques  to  do  the  following: 

•  Monitor  the  selected  subprocesses  using  statistical  and  other 
quantitative  techniques 

•  Determine  whether  or  not  the  project’s  quality  and  process  performance 
objectives  are  being  satisfied 

•  Perform  root  cause  analysis  of  selected  issues  to  address  deficiencies 

SP  2.1  Monitor  the  Performance  of  Selected  Subprocesses 

Monitor  the  performance  of  selected  subprocesses  using 
statistical  and  other  quantitative  techniques. 

The  intent  of  this  specific  practice  is  to  use  statistical  and  other  quantitative 
techniques  to  analyze  variation  in  subprocess  performance  and  to 
determine  actions  necessary  to  achieve  each  subprocess’s  quality  and 
process  performance  objectives. 

Example  Work  Products 

1 .  Natural  bounds  of  process  performance  for  each  selected  subprocess 
attribute 

2.  The  actions  needed  to  address  deficiencies  in  the  process  stability  or 
capability  of  each  selected  subprocess 

Example  Supplier  Deliverables 

1 .  Actions  needed  to  address  deficiencies  in  supplier  process 
performance  or  the  quality  of  deliverables 

Subpractices 

1 .  Collect  data,  as  defined  by  the  selected  measures,  on  the 
subprocesses  as  they  execute. 

2.  Monitor  the  variation  and  stability  of  the  selected  subprocesses  and 
address  deficiencies. 

This  analysis  involves  evaluating  measurements  in  relation  to  the  natural  bounds 
calculated  for  each  selected  measure  and  identifying  outliers  or  other  signals  of 
potential  non-random  behavior,  determining  their  causes  and  preventing  or  mitigating 
the  effects  of  their  recurrence  (i.e.,  addressing  special  causes  of  variation). 

During  such  analysis,  be  sensitive  to  the  sufficiency  of  the  data  and  to  shifts  in  process 
performance  that  can  affect  the  ability  to  achieve  or  maintain  process  stability. 

Analytic  techniques  for  identifying  outliers  or  signals  include  statistical  process  control 
charts,  prediction  intervals,  and  analysis  of  variance.  Some  of  these  techniques  involve 
graphical  displays. 

Other  deficiencies  in  process  performance  to  consider  include  when  variation  is  too 
large  to  have  confidence  that  the  subprocess  is  stable,  or  too  great  to  assess  its 
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capability  (next  subpractice)  of  achieving  the  objectives  established  for  each  selected 
attribute. 

3.  Monitor  the  capability  and  performance  of  the  selected  subprocesses 
and  address  deficiencies. 

The  intent  of  this  subpractice  is  to  identify  what  actions  to  take  to  help  the  subprocess 
achieve  its  quality  and  process  performance  objectives.  Be  sure  that  the  subprocess 
performance  is  stable  relative  to  the  selected  measures  (previous  subpractice)  before 
comparing  its  capability  to  its  quality  and  process  performance  objectives. 

i  Examples  of  actions  that  can  be  taken  when  the  performance  of  a  selected 
:  subprocess  fails  to  satisfy  its  objectives  include  the  following: 

j  •  Improving  the  implementation  of  the  existing  subprocess  to  reduce  its  variation  or 
j  improve  its  performance  (i.e.,  addressing  common  causes  of  variation) 

j  •  Identifying  and  implementing  an  alternative  subprocess  through  identifying  and 
j  adopting  new  process  elements,  subprocesses,  and  technologies  that  may  help 
:  better  align  with  objectives 

i  •  Identifying  risks  and  risk  mitigation  strategies  for  each  deficiency  in  subprocess 
i  capability 

:  •  Renegotiating  or  re-deriving  objectives  for  each  selected  attribute  of  a  subprocess 
:  so  that  they  can  be  met  by  the  subprocess 


Some  actions  can  involve  the  use  of  root  cause  analysis,  which  is  further  described  in 
SP  2.3. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  managing  corrective  action  to  closure. 

SP  2.2  Manage  Project  Performance 

Manage  the  project  using  statistical  and  other  quantitative 
techniques  to  determine  whether  or  not  the  project’s  objectives  for 
quality  and  process  performance  will  be  satisfied. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  aligning  measurement  and  analysis  activities  and  providing 
measurement  results. 

Refer  to  the  Organizational  Performance  Management  process  area  for 
more  information  about  managing  business  performance. 

This  specific  practice  is  project  focused  and  uses  multiple  inputs  to  predict  if 
the  project's  quality  and  process  performance  objectives  will  be  satisfied. 
Based  on  this  prediction,  risks  associated  with  not  meeting  the  project’s 
quality  and  process  performance  objectives  are  identified  and  managed, 
and  actions  to  address  deficiencies  are  defined  as  appropriate. 

Key  inputs  to  this  analysis  include  the  individual  subprocess  stability  and 
capability  data  derived  from  the  previous  specific  practice,  as  well  as 
performance  data  from  monitoring  other  subprocesses,  risks,  and  suppliers’ 
progress. 


Quantitative  Project  Management  (QPM) 


321 


CMMI  for  Acquisition,  Version  1.3 


Example  Work  Products 

1 .  Predictions  of  results  to  be  achieved  relative  to  the  project’s  quality  and 
process  performance  objectives 

2.  Graphical  displays  and  data  tabulations  for  other  subprocesses,  which 
support  quantitative  management 

3.  Assessment  of  risks  of  not  achieving  the  project’s  quality  and  process 
performance  objectives 

4.  Actions  needed  to  address  deficiencies  in  achieving  project  objectives 

Example  Supplier  Deliverables 

1 .  Supplier  process  performance  data  for  quality  and  process 
performance  objectives  and  expected  service  levels 

Subpractices 

1 .  Periodically  review  the  performance  of  subprocesses. 

Stability  and  capability  data  from  monitoring  selected  subprocesses,  as  described  in 
SP2.1 ,  are  a  key  input  into  understanding  the  project’s  overall  ability  to  meet  quality 
and  process  performance  objectives. 

In  addition,  subprocesses  not  selected  for  their  impact  on  project  objectives  can  still 
create  problems  or  risks  for  the  project  and  thus  some  level  of  monitoring  for  these 
subprocesses  may  be  desired  as  well.  Analytic  techniques  involving  the  use  of 
graphical  displays  can  also  prove  to  be  useful  to  understanding  subprocess 
performance. 

2.  Monitor  and  analyze  suppliers’  progress  toward  achieving  their  quality 
and  process  performance  objectives. 

3.  Periodically  review  and  analyze  actual  results  achieved  against 
established  interim  objectives. 

4.  Use  process  performance  models  calibrated  with  project  data  to 
assess  progress  toward  achieving  the  project’s  quality  and  process 
performance  objectives. 

Process  performance  models  are  used  to  assess  progress  toward  achieving  objectives 
that  cannot  be  measured  until  a  future  phase  in  the  project  lifecycle.  Objectives  can 
either  be  interim  objectives  or  overall  objectives. 

i - 

|  An  example  is  the  use  of  process  performance  models  to  predict  the  latent  defects  in 

I  work  products  in  future  phases  or  in  the  delivered  product. 


Calibration  of  process  performance  models  is  based  on  the  results  obtained  from 
performing  the  activities  described  in  the  previous  subpractices  and  specific  practices. 

5.  Identify  and  manage  risks  associated  with  achieving  the  project’s 
quality  and  process  performance  objectives. 

Refer  to  the  Risk  Management  process  area  for  more  information 
about  identifying  and  analyzing  risks  and  mitigating  risks. 
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Example  sources  of  risks  include  the  following: 

•  Subprocesses  having  inadequate  performance  or  capability 

•  Suppliers  not  achieving  their  quality  and  process  performance  objectives 

•  Lack  of  visibility  into  supplier  capability 

•  Inaccuracies  in  the  process  performance  models  used  for  predicting  performance 

•  Deficiencies  in  predicted  process  performance  (estimated  progress) 

•  Other  identified  risks  associated  with  identified  deficiencies 


6.  Determine  and  implement  actions  needed  to  address  deficiencies  in 
achieving  the  project’s  quality  and  process  performance  objectives. 

The  intent  of  this  subpractice  is  to  identify  and  implement  the  right  set  of  actions, 
resources,  and  schedule  to  place  the  project  back  on  a  path  toward  achieving  its 
objectives. 

i  Examples  of  actions  that  can  be  taken  to  address  deficiencies  in  achieving  the 
:  project’s  objectives  include  the  following: 

:  •  Changing  quality  and  process  performance  objectives  so  that  they  are  within  the 
:  expected  range  of  the  project’s  defined  process 

j  •  Improving  the  implementation  of  the  project’s  defined  process 

:  •  Adopting  new  subprocesses  and  technologies  that  have  the  potential  for  satisfying 
j  objectives  and  managing  associated  risks 

j  •  Identifying  the  risk  and  risk  mitigation  strategies  for  deficiencies 
;  •  Terminating  the  project 


Some  actions  can  involve  the  use  of  root  cause  analysis,  which  is  addressed  in  the 
next  specific  practice. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  managing  corrective  action  to  closure. 

When  corrective  actions  result  in  changes  to  attributes  or  measures  related  to 
adjustable  factors  in  a  process  performance  model,  the  model  can  be  used  to  predict 
the  effects  of  the  actions.  When  undertaking  critical  corrective  actions  in  high  risk 
situations,  a  process  performance  model  can  be  created  to  predict  the  effects  of  the 
change. 

SP  2.3  Perform  Root  Cause  Analysis 

Perform  root  cause  analysis  of  selected  issues  to  address 
deficiencies  in  achieving  the  project’s  quality  and  process 
performance  objectives. 

Issues  to  address  include  deficiencies  in  subprocess  stability  and  capability, 
and  deficiencies  in  project  performance  relative  to  its  objectives. 

Root  cause  analysis  of  selected  issues  is  best  performed  shortly  after  the 
problem  is  first  identified,  while  the  event  is  still  recent  enough  to  be 
carefully  investigated. 
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The  formality  of  and  effort  required  for  a  root  cause  analysis  can  vary 
greatly  and  can  be  determined  by  such  factors  as  the  stakeholders  who  are 
involved;  the  risk  or  opportunity  that  is  present;  the  complexity  of  the 
situation;  the  frequency  with  which  the  situation  could  recur;  the  availability 
of  data,  baselines,  and  models  that  can  be  used  in  the  analysis;  and  how 
much  time  has  passed  since  the  events  triggering  the  deficiency. 

In  the  case  of  a  subprocess  that  exhibits  too  much  variation,  is  performed 
rarely,  and  involves  different  stakeholders,  it  could  take  weeks  or  months  to 
identify  root  causes. 

Likewise,  the  actions  to  take  can  range  significantly  in  terms  of  effort  and 
time  needed  to  determine,  plan,  and  implement  them. 

It  is  often  difficult  to  know  how  much  time  is  needed  unless  an  initial 
analysis  of  the  deficiencies  is  undertaken. 

Refer  to  the  Causal  Analysis  and  Resolution  process  area  for  more 
information  about  identifying  causes  of  selected  outcomes  and  taking  action 
to  improve  process  performance. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  aligning  measurement  and  analysis  activities  and  providing 
measurement  results. 

Example  Work  Products 

1 .  Subprocess  and  project  performance  measurements  and  analyses 
(including  statistical  analyses)  recorded  in  the  organization’s 
measurement  repository 

2.  Graphical  displays  of  data  used  to  understand  subprocess  and  project 
performance  and  performance  trends 

3.  Identified  root  causes  and  potential  actions  to  take 

Subpractices 

1 .  Perform  root  cause  analysis,  as  appropriate,  to  diagnose  process 
performance  deficiencies. 

Process  performance  baselines  and  models  are  used  in  diagnosing  deficiencies; 
identifying  possible  solutions;  predicting  future  project  and  process  performance;  and 
evaluating  potential  actions  as  appropriate. 

The  use  of  process  performance  models  in  predicting  future  project  and  process 
performance  is  described  in  a  subpractice  of  the  previous  specific  practice. 

2.  Identify  and  analyze  potential  actions. 

3.  Implement  selected  actions. 

4.  Assess  the  impact  of  the  actions  on  subprocess  performance. 

This  assessment  of  impact  can  include  an  evaluation  of  the  statistical  significance  of 
the  impacts  resulting  from  the  actions  taken  to  improve  process  performance. 
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REQUIREMENTS  MANAGEMENT 


A  Project  Management  Process  Area  at  Maturity  Level  2 


Purpose 


The  purpose  of  Requirements  Management  (REQM)  is  to  manage 
requirements  of  the  project’s  products  and  product  components  and  to 
ensure  alignment  between  those  requirements  and  the  project’s  plans  and 
work  products. 


Introductory  Notes 


Requirements  management  processes  manage  all  requirements  received 
or  generated  by  the  project,  including  both  technical  and  nontechnical 
requirements  as  well  as  requirements  levied  on  the  project  by  the 
organization. 

In  particular,  if  the  Acquisition  Requirements  Development  process  area  is 
implemented,  the  resulting  processes  will  generate  customer  and 
contractual  requirements  to  be  managed  by  requirements  management 
processes.  When  the  Requirements  Management  and  the  Acquisition 
Requirements  Development  process  areas  are  both  implemented,  their 
associated  processes  can  be  closely  tied  and  performed  concurrently. 

Throughout  the  process  areas,  where  the  terms  “product”  and  “product 
component”  are  used,  their  intended  meanings  also  encompass  services, 
service  systems,  and  their  components. 

The  project  takes  appropriate  steps  to  ensure  that  the  set  of  approved 
requirements  is  managed  to  support  the  planning  and  execution  needs  of 
the  project.  When  a  project  receives  requirements  from  an  approved 
requirements  provider,  these  requirements  are  reviewed  with  the 
requirements  provider  to  resolve  issues  and  prevent  misunderstanding 
before  requirements  are  incorporated  into  project  plans.  Once  the 
requirements  provider  and  the  requirements  receiver  reach  an  agreement, 
commitment  to  the  requirements  is  obtained  from  project  participants.  The 
project  manages  changes  to  requirements  as  they  evolve  and  identifies 
inconsistencies  that  occur  among  plans,  work  products,  and  requirements. 

Part  of  managing  requirements  is  documenting  requirements  changes  and 
their  rationale  and  maintaining  bidirectional  traceability  between  source 
requirements,  all  product  and  product  component  requirements,  and  other 
specified  work  products.  (See  the  definition  of  “bidirectional  traceability”  in 
the  glossary.) 

All  projects  have  requirements.  In  the  case  of  maintenance  activities, 
changes  are  based  on  changes  to  the  existing  requirements,  design,  or 
implementation.  The  requirements  changes,  if  any,  might  be  documented  in 
change  requests  from  the  customer  or  end  users,  or  they  might  take  the 
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form  of  new  requirements  received  from  the  requirements  development 
process.  Regardless  of  their  source  or  form,  the  maintenance  activities  that 
are  driven  by  changes  to  requirements  are  managed  accordingly. 


Related  Process  Areas 


Refer  to  the  Acquisition  Requirements  Development  process  area  for  more 
information  about  developing  and  analyzing  customer  and  contractual 
requirements. 

Refer  to  the  Configuration  Management  process  area  for  more  information 
about  establishing  baselines  and  tracking  and  controlling  changes. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  the  project  against  the  plan  and  managing 
corrective  action  to  closure. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
establishing  and  maintaining  plans  that  define  project  activities. 

Refer  to  the  Risk  Management  process  area  for  more  information  about 
identifying  and  analyzing  risks. 

Specific  Goal  and  Practice  Summary 

SG  1  Manage  Requirements 

SP1.1  Understand  Requirements 

SP  1 .2  Obtain  Commitment  to  Requirements 

SP1.3  Manage  Requirements  Changes 

SP  1.4  Maintain  Bidirectional  Traceability  of  Requirements 

SP  1 .5  Ensure  Alignment  Between  Project  Work  and  Requirements 

Specific  Practices  by  Goal 


SG  1  Manage  Requirements 

Requirements  are  managed  and  inconsistencies  with  project  plans  and  work 
products  are  identified. 

The  project  maintains  a  current  and  approved  set  of  requirements  over  the 
life  of  the  project  by  doing  the  following: 

•  Managing  all  changes  to  requirements 

•  Maintaining  relationships  among  requirements,  project  plans,  and  work 
products 

•  Ensuring  alignment  among  requirements,  project  plans,  and  work 
products 

•  Taking  corrective  action 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  managing  corrective  action  to  closure. 

Requirements  management  typically  includes  directly  managing  changes  to 
customer  and  contractual  requirements  developed  by  the  acquirer  and 
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overseeing  the  supplier’s  requirements  management  process. 
Requirements  changes  can  result  in  changes  to  the  supplier  agreement. 

SP1.1  Understand  Requirements 

Develop  an  understanding  with  the  requirements  providers  on  the 
meaning  of  the  requirements. 

As  the  project  matures  and  requirements  are  derived,  all  activities  or 
disciplines  will  receive  requirements.  To  avoid  requirements  creep,  criteria 
are  established  to  designate  appropriate  channels  or  official  sources  from 
which  to  receive  requirements.  Those  who  receive  requirements  conduct 
analyses  of  them  with  the  provider  to  ensure  that  a  compatible,  shared 
understanding  is  reached  on  the  meaning  of  requirements.  The  result  of 
these  analyses  and  dialogs  is  a  set  of  approved  requirements. 

Example  Work  Products 

1 .  Lists  of  criteria  for  distinguishing  appropriate  requirements  providers 

2.  Criteria  for  evaluation  and  acceptance  of  requirements 

3.  Results  of  analyses  against  criteria 

4.  A  set  of  approved  requirements 

Subpractices 

1 .  Establish  criteria  for  distinguishing  appropriate  requirements  providers. 

2.  Establish  objective  criteria  for  the  evaluation  and  acceptance  of 
requirements. 

Lack  of  evaluation  and  acceptance  criteria  often  results  in  inadequate  verification, 
costly  rework,  or  customer  rejection. 

I  Examples  of  evaluation  and  acceptance  criteria  include  the  following: 
i  •  Clearly  and  properly  stated 
i  •  Complete 

:  •  Consistent  with  one  another 
:  •  Uniquely  identified 

:  •  Consistent  with  overall  architectural  approach  and  quality  attribute  priorities  (e.g., 
j  as  defined  in  the  acquisition  strategy) 

j  •  Appropriate  to  implement 
|  •  Verifiable  (i.e.,  testable) 

:  •  Traceable 
i  •  Achievable 
i  •  Tied  to  business  value 
:  •  Identified  as  a  priority  for  the  customer 

3.  Analyze  requirements  to  ensure  that  established  criteria  are  met. 

4.  Reach  an  understanding  of  requirements  with  requirements  providers 
so  that  project  participants  can  commit  to  them. 
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SP  1.2  Obtain  Commitment  to  Requirements 

Obtain  commitment  to  requirements  from  project  participants. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  commitments. 

The  previous  specific  practice  dealt  with  reaching  an  understanding  with 
requirements  providers.  This  specific  practice  deals  with  agreements  and 
commitments  among  those  who  carry  out  activities  necessary  to  implement 
requirements.  Requirements  evolve  throughout  the  project.  As 
requirements  evolve,  this  specific  practice  ensures  that  project  participants 
commit  to  the  current  and  approved  requirements  and  the  resulting 
changes  in  project  plans,  activities,  and  work  products. 

Changes  to  requirements  can  lead  to  changes  in  supplier  agreements. 
These  changes  should  be  agreed  on  by  the  acquirer  and  supplier  after 
appropriate  negotiations. 

Example  Work  Products 

1 .  Requirements  impact  assessments 

2.  Documented  commitments  to  requirements  and  requirements  changes 

Example  Supplier  Deliverables 

1 .  Supplier  requirements  impact  assessments 

Subpractices 

1 .  Assess  the  impact  of  requirements  on  existing  commitments. 

The  impact  on  the  project  participants  should  be  evaluated  when  the  requirements 
change  or  at  the  start  of  a  new  requirement. 

2.  Negotiate  and  record  commitments. 

Changes  to  existing  commitments  should  be  negotiated  before  project  participants 
commit  to  a  new  requirement  or  requirement  change. 

The  acquirer  negotiates  commitments  with  the  customer  and  supplier  before 
committing  to  requirement  changes. 

SP  1.3  Manage  Requirements  Changes 

Manage  changes  to  requirements  as  they  evolve  during  the  project. 

Refer  to  the  Configuration  Management  process  area  for  more  information 
about  tracking  and  controlling  changes. 

Requirements  change  for  a  variety  of  reasons.  As  needs  change  and  as 
work  proceeds,  changes  may  have  to  be  made  to  existing  requirements.  It 
is  essential  to  manage  these  additions  and  changes  efficiently  and 
effectively.  To  effectively  analyze  the  impact  of  changes,  it  is  necessary  that 
the  source  of  each  requirement  is  known  and  the  rationale  for  the  change  is 
documented.  The  project  may  want  to  track  appropriate  measures  of 
requirements  volatility  to  judge  whether  new  or  revised  approach  to  change 
control  is  necessary. 
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If  contractual  requirements  defined  in  the  supplier  agreement  are  affected 
by  the  changes,  the  supplier  agreement  also  must  be  aligned  with  the 
changed  requirements. 

Example  Work  Products 

1 .  Requirements  change  requests 

2.  Requirements  change  impact  reports 

3.  Requirements  status 

4.  Requirements  database 

Example  Supplier  Deliverables 

1 .  Requirements  change  requests 

2.  Requirements  change  impact  reports 

Subpractices 

1 .  Document  all  requirements  and  requirements  changes  that  are  given  to 
or  generated  by  the  project. 

2.  Maintain  a  requirements  change  history,  including  the  rationale  for 
changes. 

Maintaining  the  change  history  helps  to  track  requirements  volatility. 

3.  Evaluate  the  impact  of  requirement  changes  from  the  standpoint  of 
relevant  stakeholders. 

Requirements  changes  that  affect  the  architectures  of  products  being  acquired  can 
affect  many  stakeholders. 

4.  Make  requirements  and  change  data  available  to  the  project. 

SP  1.4  Maintain  Bidirectional  Traceability  of  Requirements 

Maintain  bidirectional  traceability  among  requirements  and  work 
products. 

The  intent  of  this  specific  practice  is  to  maintain  the  bidirectional  traceability 
of  requirements.  (See  the  definition  of  “bidirectional  traceability”  in  the 
glossary.)  When  requirements  are  managed  well,  traceability  can  be 
established  from  a  source  requirement  to  its  lower  level  requirements  and 
from  those  lower  level  requirements  back  to  their  source  requirements. 

Such  bidirectional  traceability  helps  to  determine  whether  all  source 
requirements  have  been  completely  addressed  and  whether  all  lower  level 
requirements  can  be  traced  to  a  valid  source. 

Requirements  traceability  also  covers  relationships  to  other  entities  such  as 
intermediate  and  final  work  products,  changes  in  design  documentation, 
and  test  plans.  Traceability  can  cover  horizontal  relationships,  such  as 
across  interfaces,  as  well  as  vertical  relationships.  Traceability  is 
particularly  needed  when  assessing  the  impact  of  requirements  changes  on 
project  activities  and  work  products. 
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The  supplier  maintains  comprehensive  bidirectional  traceability  to 
requirements  defined  in  the  supplier  agreement  by  the  acquirer,  and  the 
acquirer  verifies  that  traceability.  The  acquirer  maintains  bidirectional 
traceability  between  customer  requirements  and  contractual  requirements. 

t - 

|  Examples  of  what  aspects  of  traceability  to  consider  include  the  following: 

|  •  Scope  of  traceability:  The  boundaries  within  which  traceability  is  needed 
:  •  Definition  of  traceability:  The  elements  that  need  logical  relationships 
i  •  Type  of  traceability:  When  horizontal  and  vertical  traceability  is  needed 


Example  Work  Products 

1 .  Requirements  traceability  matrix 

2.  Requirements  tracking  system 

Example  Supplier  Deliverables 

1 .  Comprehensive  requirements  traceability  matrix  managed  by  the 
supplier  as  required  by  the  supplier  agreement 

Subpractices 

1 .  Maintain  requirements  traceability  to  ensure  that  the  source  of  lower 
level  (i.e.,  derived)  requirements  is  documented. 

Traceability  from  customer  to  contractual  requirements  is  maintained  by  the  acquirer. 
Traceability  from  contractual  requirements  to  derived  or  additional  requirements  is 
maintained  by  the  supplier. 

2.  Maintain  requirements  traceability  from  a  requirement  to  its  derived 
requirements  and  allocation  to  work  products. 

Requirements  changes  that  affect  the  architectures  of  products  being  acquired  can 
affect  many  stakeholders. 

3.  Generate  a  requirements  traceability  matrix. 

A  comprehensive  traceability  matrix,  tracing  from  customer  requirements  to  contractual 
requirements  is  maintained  by  the  acquirer.  A  comprehensive  traceability  matrix, 
tracing  from  contractual  requirements  to  lower  level  requirements  is  maintained  by  the 
supplier. 

SP  1.5  Ensure  Alignment  Between  Project  Work  and  Requirements 

Ensure  that  project  plans  and  work  products  remain  aligned  with 
requirements. 

This  specific  practice  finds  inconsistencies  between  requirements  and 
project  plans  and  work  products  and  initiates  corrective  actions  to  resolve 
them. 

Corrective  actions  taken  by  the  project  to  resolve  inconsistencies  can  also 
result  in  changes  to  project  plans  and  supplier  agreements. 
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Example  Work  Products 

1 .  Documentation  of  inconsistencies  between  requirements  and  project 
plans  and  work  products,  including  sources  and  conditions 

2.  Corrective  actions 

Subpractices 

1 .  Review  project  plans,  activities,  and  work  products  for  consistency  with 
requirements  and  changes  made  to  them. 

2.  Identify  the  source  of  the  inconsistency  (if  any). 

3.  Identify  any  changes  that  should  be  made  to  plans  and  work  products 
resulting  from  changes  to  the  requirements  baseline. 

4.  Initiate  any  necessary  corrective  actions. 
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RISK  MANAGEMENT 


A  Project  Management  Process  Area  at  Maturity  Level  3 


Purpose 


The  purpose  of  Risk  Management  (RSKM)  is  to  identify  potential  problems 
before  they  occur  so  that  risk  handling  activities  can  be  planned  and 
invoked  as  needed  across  the  life  of  the  product  or  project  to  mitigate 
adverse  impacts  on  achieving  objectives. 


Introductory  Notes 


Risk  management  is  a  continuous,  forward-looking  process  that  is  an 
important  part  of  project  management.  Risk  management  should  address 
issues  that  could  endanger  achievement  of  critical  objectives.  A  continuous 
risk  management  approach  effectively  anticipates  and  mitigates  risks  that 
can  have  a  critical  impact  on  a  project. 

Effective  risk  management  includes  early  and  aggressive  risk  identification 
through  collaboration  and  the  involvement  of  relevant  stakeholders  as 
described  in  the  stakeholder  involvement  plan  addressed  in  the  Project 
Planning  process  area.  Strong  leadership  among  all  relevant  stakeholders 
is  needed  to  establish  an  environment  for  free  and  open  disclosure  and 
discussion  of  risk. 

Risk  management  should  consider  both  internal  and  external,  as  well  as 
both  technical  and  non-technical,  sources  of  cost,  schedule,  performance, 
and  other  risks.  Early  and  aggressive  detection  of  risk  is  important  because 
it  is  typically  easier,  less  costly,  and  less  disruptive  to  make  changes  and 
correct  work  efforts  during  the  earlier,  rather  than  the  later,  phases  of  the 
project. 

When  the  project  identifies  and  assesses  project  risks  during  project 
planning  and  manages  risks  throughout  the  life  of  the  project,  risk 
identification  includes  identifying  risks  associated  with  the  acquisition 
process  and  the  use  of  a  supplier  to  perform  project  work.  Initially,  the 
acquisition  strategy  identifies  risks  associated  with  an  acquisition.  The 
approach  to  the  acquisition  is  planned  based  on  those  risks.  As  the  project 
progresses  to  the  selection  of  a  supplier,  risks  specific  to  the  supplier’s 
technical  and  management  approach  become  important  to  the  success  of 
the  acquisition. 

These  risks  refer  to  the  capability  of  the  supplier  to  meet  contractual 
requirements,  including  schedules  and  cost  targets.  When  the  project 
selects  a  supplier  and  awards  the  supplier  agreement,  the  acquirer 
continues  to  manage  project  risks,  including  risks  related  to  the  supplier 
meeting  its  contractual  requirements.  Typically  the  acquirer  does  not 
manage  risks  being  addressed  or  managed  by  the  supplier. 
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Industry  standards  can  help  when  determining  how  to  prevent  or  mitigate 
specific  risks  commonly  found  in  a  particular  industry.  Certain  risks  can  be 
proactively  managed  or  mitigated  by  reviewing  industry  best  practices  and 
lessons  learned. 

Risk  management  can  be  divided  into  the  following  parts: 

•  Defining  a  risk  management  strategy 

•  Identifying  and  analyzing  risks 

•  Handling  identified  risks,  including  the  implementation  of  risk  mitigation 
plans  as  needed 

Both  the  acquirer  and  supplier  should  understand  project  risks  and  how  to 
modify  the  risk  management  strategy  and  plans  as  a  project  progresses 
through  its  lifecycle.  Managing  project  risks  requires  a  close  partnership 
between  the  acquirer  and  supplier.  Both  should  share  appropriate  risk 
management  documentation,  understand  the  risks,  and  develop  and 
execute  risk  management  activities. 

The  complexity  of  an  acquirer-supplier  relationship  increases  the  need  for 
early  and  aggressive  risk  identification.  For  example,  acquirer  capabilities, 
supplier  experience  working  with  the  acquirer,  financial  stability  of  the 
supplier,  and  availability  of  well-defined  dispute  resolution  processes  all 
influence  the  risk  of  a  project. 

As  represented  in  the  Project  Planning  and  Project  Monitoring  and  Control 
process  areas,  organizations  initially  may  focus  on  risk  identification  for 
awareness  and  react  to  the  realization  of  these  risks  as  they  occur.  The 
Risk  Management  process  area  describes  an  evolution  of  these  specific 
practices  to  systematically  plan,  anticipate,  and  mitigate  risks  to  proactively 
minimize  their  impact  on  the  project. 

Although  the  primary  emphasis  of  the  Risk  Management  process  area  is  on 
the  project,  these  concepts  can  also  be  applied  to  manage  organizational 
risks. 

Related  Process  Areas 


Refer  to  the  Solicitation  and  Supplier  Agreement  Development  process 
area  for  more  information  about  establishing  supplier  agreements. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal  evaluation 
process  that  evaluates  identified  alternatives  against  established  criteria. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  project  risks. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
identifying  project  risks  and  planning  stakeholder  involvement. 
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Specific  Goal  and  Practice  Summary 

SG  1  Prepare  for  Risk  Management 

SP  1 .1  Determine  Risk  Sources  and  Categories 
SP1.2  Define  Risk  Parameters 
SP  1 .3  Establish  a  Risk  Management  Strategy 
SG  2  Identify  and  Analyze  Risks 
SP  2.1  Identify  Risks 

SP  2.2  Evaluate,  Categorize,  and  Prioritize  Risks 

SG  3  Mitigate  Risks 

SP  3.1  Develop  Risk  Mitigation  Plans 
SP  3.2  Implement  Risk  Mitigation  Plans 

Specific  Practices  by  Goal 


SG  1  Prepare  for  Risk  Management 

Preparation  for  risk  management  is  conducted. 

Prepare  for  risk  management  by  establishing  and  maintaining  a  strategy  for 
identifying,  analyzing,  and  mitigating  risks.  Typically,  this  strategy  is 
documented  in  a  risk  management  plan.  The  risk  management  strategy 
addresses  specific  actions  and  the  management  approach  used  to  apply 
and  control  the  risk  management  program.  The  strategy  typically  includes 
identifying  sources  of  risk,  the  scheme  used  to  categorize  risks,  and 
parameters  used  to  evaluate,  bound,  and  control  risks  for  effective 
handling. 

SP  1.1  Determine  Risk  Sources  and  Categories 

Determine  risk  sources  and  categories. 

Identifying  risk  sources  provides  a  basis  for  systematically  examining 
changing  situations  over  time  to  uncover  circumstances  that  affect  the 
ability  of  the  project  to  meet  its  objectives.  Risk  sources  are  both  internal 
and  external  to  the  project.  As  the  project  progresses,  additional  sources  of 
risk  can  be  identified.  Establishing  categories  for  risks  provides  a 
mechanism  for  collecting  and  organizing  risks  as  well  as  ensuring 
appropriate  scrutiny  and  management  attention  to  risks  that  can  have 
serious  consequences  on  meeting  project  objectives. 

Acquirers  initially  identify  and  categorize  risk  sources  and  categories  for  the 
project  and  refine  those  sources  and  categories  over  time  (e.g.,  schedule, 
cost,  sourcing,  contract  management,  supplier  execution,  technology 
readiness,  human  safety,  reliability  related  risks,  other  issues  outside  the 
control  of  the  acquirer).  The  supplier  is  also  a  source  of  risk  (e.g.,  financial 
stability  of  the  suppler,  the  possibility  of  the  supplier’s  acquisition  by  another 
organization). 

Example  Work  Products 

1 .  Risk  source  lists  (external  and  internal) 

2.  Risk  categories  list 
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Subpractices 

1 .  Determine  risk  sources. 

Risk  sources  are  fundamental  drivers  that  cause  risks  in  a  project  or  organization. 
There  are  many  sources  of  risks,  both  internal  and  external  to  a  project.  Risk  sources 
identify  where  risks  can  originate. 

i - - 

j  Typical  internal  and  external  risk  sources  include  the  following: 

■  •  Uncertain  requirements 
j  •  Unprecedented  efforts  (i.e.,  estimates  unavailable) 
j  •  Infeasible  design 

j  •  Competing  quality  attribute  requirements  that  affect  technical  solution  and  design 

i  •  Supplier  architectural  decisions  that  affect  quality  attribute  requirements  or 
i  acquirer’s  business  objectives 

i  •  Unavailable  technology 
j  •  Unrealistic  schedule  estimates  or  allocation 
j  •  Inadequate  staffing  and  skills 
j  •  Cost  or  funding  issues 
:  •  Uncertain  or  inadequate  subcontractor  capability 
j  •  Uncertain  or  inadequate  supplier  capability 

j  •  Inadequate  communication  with  actual  or  potential  customers  or  with  their 
:  representatives 

:  •  Disruptions  to  the  continuity  of  operations 
:  •  Regulatory  constraints  (e.g.  security,  safety,  environment) 


Many  of  these  sources  of  risk  are  accepted  without  adequately  planning  for  them. 
Early  identification  of  both  internal  and  external  sources  of  risk  can  lead  to  early 
identification  of  risks.  Risk  mitigation  plans  can  then  be  implemented  early  in  the 
project  to  preclude  occurrence  of  risks  or  reduce  consequences  of  their  occurrence. 

2.  Determine  risk  categories. 

Risk  categories  are  “bins”  used  for  collecting  and  organizing  risks.  Identifying  risk 
categories  aids  the  future  consolidation  of  activities  in  risk  mitigation  plans. 

i - 

j  The  following  factors  can  be  considered  when  determining  risk  categories: 

j  •  Phases  of  the  project’s  lifecycle  model  (e.g.,  requirements,  design,  manufacturing, 
test  and  evaluation,  delivery,  disposal) 

:  •  Supplier  risks  (e.g.,  financial  viability  of  the  supplier,  the  geographic  location  of 
i  supplier  resources) 

:  •  Product  safety,  security,  and  reliability 
:  •  Types  of  processes  used 
:  •  Types  of  products  used 

j  •  Project  management  risks  (e.g.,  contract  risks,  budget  risks,  schedule  risks, 
j  resource  risks) 

j  •  Technical  performance  risks  (e.g.,  quality  attribute  related  risks,  supportability 
j  risks) 
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A  risk  taxonomy  can  be  used  to  provide  a  framework  for  determining  risk  sources  and 
categories, 

SP  1.2  Define  Risk  Parameters 

Define  parameters  used  to  analyze  and  categorize  risks  and  to 
control  the  risk  management  effort. 

Parameters  for  evaluating,  categorizing,  and  prioritizing  risks  include  the 
following: 

•  Risk  likelihood  (i.e.,  probability  of  risk  occurrence) 

•  Risk  consequence  (i.e.,  impact  and  severity  of  risk  occurrence) 

•  Thresholds  to  trigger  management  activities 

Risk  parameters  are  used  to  provide  common  and  consistent  criteria  for 
comparing  risks  to  be  managed.  Without  these  parameters,  it  is  difficult  to 
gauge  the  severity  of  an  unwanted  change  caused  by  a  risk  and  to  prioritize 
the  actions  required  for  risk  mitigation  planning. 

Projects  should  document  the  parameters  used  to  analyze  and  categorize 
risks  so  that  they  are  available  for  reference  throughout  the  life  of  the 
project  because  circumstances  change  over  time.  Using  these  parameters, 
risks  can  easily  be  re-categorized  and  analyzed  when  changes  occur. 

The  project  can  use  techniques  such  as  failure  mode  and  effects  analysis 
(FMEA)  to  examine  risks  of  potential  failures  in  the  acquisition  strategy, 
acquisition,  or  in  selected  transition  and  product  support  processes.  Such 
techniques  can  help  to  provide  discipline  in  working  with  risk  parameters. 

Example  Work  Products 

1 .  Risk  evaluation,  categorization,  and  prioritization  criteria 

2.  Risk  management  requirements  (e.g.,  control  and  approval  levels, 
reassessment  intervals) 

Subpractices 

1 .  Define  consistent  criteria  for  evaluating  and  quantifying  risk  likelihood 
and  severity  levels. 

Consistently  used  criteria  (e.g.,  bounds  on  likelihood,  severity  levels)  allow  impacts  of 
different  risks  to  be  commonly  understood,  to  receive  the  appropriate  level  of  scrutiny, 
and  to  obtain  the  management  attention  warranted.  In  managing  dissimilar  risks  (e.g., 
staff  safety  versus  environmental  pollution),  it  is  important  to  ensure  consistency  in  the 
end  result.  (For  example,  a  high-impact  risk  of  environmental  pollution  is  as  important 
as  a  high-impact  risk  to  staff  safety.)  One  way  of  providing  a  common  basis  for 
comparing  dissimilar  risks  is  assigning  dollar  values  to  risks  (e.g.,  through  a  process  of 
risk  monetization). 

2.  Define  thresholds  for  each  risk  category. 

For  each  risk  category,  thresholds  can  be  established  to  determine  acceptability  or 
unacceptability  of  risks,  prioritization  of  risks,  or  triggers  for  management  action. 
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Examples  of  thresholds  include  the  following: 

•  Project-wide  thresholds  could  be  established  to  involve  senior  management  when 
product  costs  exceed  1 0  percent  of  the  target  cost  or  when  cost  performance 
indices  (CPIs)  fall  below  0.95. 

•  Schedule  thresholds  could  be  established  to  involve  senior  management  when 
schedule  performance  indices  (SPIs)  fall  below  0.95. 

•  Performance  thresholds  could  be  established  to  involve  senior  management  when 
specified  key  items  (e.g.,  processor  utilization,  average  response  times)  exceed 
125  percent  of  the  intended  design. 


3.  Define  bounds  on  the  extent  to  which  thresholds  are  applied  against  or 
within  a  category. 

There  are  few  limits  to  which  risks  can  be  assessed  in  either  a  quantitative  or 
qualitative  fashion.  Definition  of  bounds  (or  boundary  conditions)  can  be  used  to  help 
define  the  extent  of  the  risk  management  effort  and  avoid  excessive  resource 
expenditures.  Bounds  can  include  the  exclusion  of  a  risk  source  from  a  category. 
These  bounds  can  also  exclude  conditions  that  occur  below  a  given  frequency. 

SP  1 .3  Establish  a  Risk  Management  Strategy 

Establish  and  maintain  the  strategy  to  be  used  for  risk 
management. 

A  comprehensive  risk  management  strategy  addresses  items  such  as  the 
following: 

•  The  scope  of  the  risk  management  effort 

•  Methods  and  tools  to  be  used  for  risk  identification,  risk  analysis,  risk 
mitigation,  risk  monitoring,  and  communication 

•  Project  specific  sources  of  risks 

•  How  risks  are  to  be  organized,  categorized,  compared,  and 
consolidated 

•  Parameters  used  for  taking  action  on  identified  risks,  including 
likelihood,  consequence,  and  thresholds 

•  Risk  mitigation  techniques  to  be  used,  such  as  prototyping,  piloting, 
simulation,  alternative  designs,  or  evolutionary  development 

•  The  definition  of  risk  measures  used  to  monitor  the  status  of  risks 

•  Time  intervals  for  risk  monitoring  or  reassessment 

The  risk  management  strategy  should  be  guided  by  a  common  vision  of 
success  that  describes  desired  future  project  outcomes  in  terms  of  the 
product  delivered,  its  cost,  and  its  fitness  for  the  task.  The  risk  management 
strategy  is  often  documented  in  a  risk  management  plan  for  the 
organization  or  project.  This  strategy  is  reviewed  with  relevant  stakeholders 
to  promote  commitment  and  understanding. 

A  risk  management  strategy  should  be  developed  early  in  the  project,  so 
that  relevant  risks  are  identified  and  managed  proactively.  Early 
identification  and  assessment  of  critical  risks  allows  the  project  to  formulate 
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risk  handling  approaches  and  adjust  project  definition  and  allocation  of 
resources  based  on  critical  risks. 

Example  Work  Products 

1 .  Project  risk  management  strategy 

SG  2  Identify  and  Analyze  Risks 

Risks  are  identified  and  analyzed  to  determine  their  relative  importance. 

The  degree  of  risk  affects  the  resources  assigned  to  handle  the  risk  and  the 
timing  of  when  appropriate  management  attention  is  required. 

Risk  analysis  entails  identifying  risks  from  identified  internal  and  external 
sources  and  evaluating  each  identified  risk  to  determine  its  likelihood  and 
consequences.  Risk  categorization,  based  on  an  evaluation  against 
established  risk  categories  and  criteria  developed  for  the  risk  management 
strategy,  provides  information  needed  for  risk  handling.  Related  risks  can 
be  grouped  to  enable  efficient  handling  and  effective  use  of  risk 
management  resources. 

SP  2.1  Identify  Risks 

Identify  and  document  risks. 

Identifying  potential  issues,  hazards,  threats,  and  vulnerabilities  that  could 
negatively  affect  work  efforts  or  plans  is  the  basis  for  sound  and  successful 
risk  management.  Risks  should  be  identified  and  described  understandably 
before  they  can  be  analyzed  and  managed  properly.  Risks  are  documented 
in  a  concise  statement  that  includes  the  context,  conditions,  and 
consequences  of  risk  occurrence. 

Risk  identification  should  be  an  organized,  thorough  approach  to  seek  out 
probable  or  realistic  risks  in  achieving  objectives.  To  be  effective,  risk 
identification  should  not  attempt  to  address  every  possible  event.  Using 
categories  and  parameters  developed  in  the  risk  management  strategy  and 
identified  sources  of  risk  can  provide  the  discipline  and  streamlining 
appropriate  for  risk  identification.  Identified  risks  form  a  baseline  for 
initiating  risk  management  activities.  Risks  should  be  reviewed  periodically 
to  reexamine  possible  sources  of  risk  and  changing  conditions  to  uncover 
sources  and  risks  previously  overlooked  or  nonexistent  when  the  risk 
management  strategy  was  last  updated. 

Risk  identification  focuses  on  the  identification  of  risks,  not  the  placement  of 
blame.  The  results  of  risk  identification  activities  should  never  be  used  by 
management  to  evaluate  the  performance  of  individuals. 
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Many  methods  are  used  for  identifying  risks.  Typical  identification  methods  include  the 
following: 

•  Examine  each  element  of  the  project  work  breakdown  structure. 

•  Conduct  a  risk  assessment  using  a  risk  taxonomy. 

•  Interview  subject  matter  experts. 

•  Review  risk  management  efforts  from  similar  products. 

•  Examine  lessons  learned  documents  or  databases. 

•  Examine  design  specifications  and  agreement  requirements. 


Some  risks  are  identified  by  examining  the  supplier’s  WBS,  product,  and 
processes  using  the  categories  and  parameters  developed  in  the  risk 
management  strategy.  Risks  can  be  identified  in  many  areas  (e.g., 
requirements,  technology,  design,  testing,  vulnerability  to  threats,  lifecycle 
costs).  An  examination  of  the  project  in  these  areas  can  help  to  develop  or 
refine  the  acquisition  strategy  and  the  risk  sharing  structure  between  the 
acquirer  and  supplier. 

The  acquirer  considers  risks  associated  with  a  supplier’s  capability  (e.g., 
meeting  schedule,  cost  requirements  for  the  project),  including  potential 
risks  to  the  acquirer’s  intellectual  capital  or  security  vulnerabilities 
introduced  by  using  a  supplier. 

Example  Work  Products 

1 .  List  of  identified  risks,  including  the  context,  conditions,  and 
consequences  of  risk  occurrence 

Example  Supplier  Deliverables 

1 .  List  of  identified  risks,  including  the  context,  conditions,  and 
consequences  of  risk  occurrence 

Subpractices 

1 .  Identify  the  risks  associated  with  cost,  schedule,  and  performance. 

Risks  associated  with  cost,  schedule,  performance,  and  other  business  objectives 
should  be  examined  to  understand  their  effect  on  project  objectives.  Risk  candidates 
can  be  discovered  that  are  outside  the  scope  of  project  objectives  but  vital  to  customer 
interests.  For  example,  risks  in  development  costs,  product  acquisition  costs,  cost  of 
spare  (or  replacement)  products,  and  product  disposition  (or  disposal)  costs  have 
design  implications. 

The  customer  may  not  have  considered  the  full  cost  of  supporting  a  fielded  product  or 
using  a  delivered  service.  The  customer  should  be  informed  of  such  risks,  but  actively 
managing  those  risks  may  not  be  necessary.  Mechanisms  for  making  such  decisions 
should  be  examined  at  project  and  organization  levels  and  put  in  place  if  deemed 
appropriate,  especially  for  risks  that  affect  the  project’s  ability  to  verify  and  validate  the 
product. 

In  addition  to  the  cost  risks  identified  above,  other  cost  risks  can  include  the  ones 
associated  with  funding  levels,  funding  estimates,  and  distributed  budgets. 
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Schedule  risks  can  include  risks  associated  with  planned  activities,  key  events,  and 
milestones. 

Performance  risks  can  include  risks  associated  with  the  following: 

•  Requirements 

•  Analysis  and  design 

•  Application  of  new  technology 

•  Physical  size 

•  Shape 

•  Weight 

•  Manufacturing  and  fabrication 

•  Product  behavior  and  operation  with  respect  to  functionality  or  quality  attributes 

•  Verification 

•  Validation 

•  Performance  maintenance  attributes 


Performance  maintenance  attributes  are  those  characteristics  that  enable  an  in-use 
product  or  service  to  provide  required  performance,  such  as  maintaining  safety  and 
security  performance. 

There  are  risks  that  do  not  fall  into  cost,  schedule,  or  performance  categories,  but  can 
be  associated  with  other  aspects  of  the  organization’s  operation. 

Examples  of  these  other  risks  include  risks  related  to  the  following: 

•  Strikes 

•  Diminishing  sources  of  supply 

•  Technology  cycle  time 

•  Competition 


2.  Review  environmental  elements  that  can  affect  the  project. 

Risks  to  a  project  that  frequently  are  missed  include  risks  supposedly  outside  the 
scope  of  the  project  (i.e.,  the  project  does  not  control  whether  they  occur  but  can 
mitigate  their  impact).  These  risks  can  include  weather  or  natural  disasters,  political 
changes,  and  telecommunications  failures. 

3.  Review  all  elements  of  the  work  breakdown  structure  as  part  of 
identifying  risks  to  help  ensure  that  all  aspects  of  the  work  effort  have 
been  considered. 

4.  Review  all  elements  of  the  project  plan  as  part  of  identifying  risks  to 
help  ensure  that  all  aspects  of  the  project  have  been  considered. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
identifying  project  risks. 

5.  Document  the  context,  conditions,  and  potential  consequences  of  each 
risk. 

Risk  statements  are  typically  documented  in  a  standard  format  that  contains  the  risk 
context,  conditions,  and  consequences  of  occurrence.  The  risk  context  provides 
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additional  information  about  the  risk  such  as  the  relative  time  frame  of  the  risk,  the 
circumstances  or  conditions  surrounding  the  risk  that  has  brought  about  the  concern, 
and  any  doubt  or  uncertainty. 

6.  Identify  the  relevant  stakeholders  associated  with  each  risk. 

SP  2.2  Evaluate,  Categorize,  and  Prioritize  Risks 

Evaluate  and  categorize  each  identified  risk  using  defined  risk 
categories  and  parameters,  and  determine  its  relative  priority. 

The  evaluation  of  risks  is  needed  to  assign  a  relative  importance  to  each 
identified  risk  and  is  used  in  determining  when  appropriate  management 
attention  is  required.  Often  it  is  useful  to  aggregate  risks  based  on  their 
interrelationships  and  develop  options  at  an  aggregate  level.  When  an 
aggregate  risk  is  formed  by  a  roll  up  of  lower  level  risks,  care  should  be 
taken  to  ensure  that  important  lower  level  risks  are  not  ignored. 

Collectively,  the  activities  of  risk  evaluation,  categorization,  and  prioritization 
are  sometimes  called  a  “risk  assessment”  or  “risk  analysis.” 

The  acquirer  should  conduct  a  risk  assessment  before  solicitation  to 
evaluate  if  the  project  can  achieve  its  technical,  schedule,  and  budget 
constraints.  Technical,  schedule,  and  cost  risks  should  be  discussed  with 
potential  suppliers  before  the  solicitation  is  released.  Using  this  approach, 
critical  risks  inherent  in  the  project  can  be  identified  and  addressed  in  the 
solicitation. 

Example  Work  Products 

1 .  List  of  risks  and  their  assigned  priority 

Example  Supplier  Deliverables 

1 .  List  of  risks  and  their  assigned  priority 

Subpractices 

1 .  Evaluate  identified  risks  using  defined  risk  parameters. 

Each  risk  is  evaluated  and  assigned  values  according  to  defined  risk  parameters, 
which  can  include  likelihood,  consequence  (i.e.,  severity,  impact),  and  thresholds.  The 
assigned  risk  parameter  values  can  be  integrated  to  produce  additional  measures, 
such  as  risk  exposure  (i.e.,  the  combination  of  likelihood  and  consequence),  which  can 
be  used  to  prioritize  risks  for  handling. 

Often,  a  scale  with  three  to  five  values  is  used  to  evaluate  both  likelihood  and 
consequence. 

I  Likelihood,  for  example,  can  be  categorized  as  remote,  unlikely,  likely,  highly  likely,  or 
i  nearly  certain. 
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Example  categories  for  consequence  include  the  following: 

•  Low 

•  Medium 
.  High 

•  Negligible 

•  Marginal 

•  Significant 

•  Critical 

•  Catastrophic 


Probability  values  are  frequently  used  to  quantify  likelihood.  Consequences  are 
generally  related  to  cost,  schedule,  environmental  impact,  or  human  measures  (e.g., 
labor  hours  lost,  severity  of  injury). 

Risk  evaluation  is  often  a  difficult  and  time  consuming  task.  Specific  expertise  or  group 
techniques  may  be  needed  to  assess  risks  and  gain  confidence  in  the  prioritization.  In 
addition,  priorities  can  require  reevaluation  as  time  progresses.  To  provide  a  basis  for 
comparing  the  impact  of  the  realization  of  identified  risks,  consequences  of  the  risks 
can  be  monetized. 

2.  Categorize  and  group  risks  according  to  defined  risk  categories. 

Risks  are  categorized  into  defined  risk  categories,  providing  a  means  to  review  them 
according  to  their  source,  taxonomy,  or  project  component.  Related  or  equivalent  risks 
can  be  grouped  for  efficient  handling.  The  cause-and-effect  relationships  between 
related  risks  are  documented. 

:  An  acquirer’s  risk  categories  can  include  sourcing,  contract  management,  and  supplier 
j  execution,  in  addition  to  project  management,  technology,  and  requirements. 

3.  Prioritize  risks  for  mitigation. 

A  relative  priority  is  determined  for  each  risk  based  on  assigned  risk  parameters.  Clear 
criteria  should  be  used  to  determine  risk  priority.  Risk  prioritization  helps  to  determine 
the  most  effective  areas  to  which  resources  for  risks  mitigation  can  be  applied  with  the 
greatest  positive  impact  on  the  project. 

SG  3 _ Mitigate  Risks _ 

Risks  are  handled  and  mitigated  as  appropriate  to  reduce  adverse  impacts  on 
achieving  objectives. 

The  steps  in  handling  risks  include  developing  risk  handling  options, 
monitoring  risks,  and  performing  risk  handling  activities  when  defined 
thresholds  are  exceeded.  Risk  mitigation  plans  are  developed  and 
implemented  for  selected  risks  to  proactively  reduce  the  potential  impact  of 
risk  occurrence.  Risk  mitigation  planning  can  also  include  contingency 
plans  to  deal  with  the  impact  of  selected  risks  that  can  occur  despite 
attempts  to  mitigate  them.  Risk  parameters  used  to  trigger  risk  handling 
activities  are  defined  by  the  risk  management  strategy. 
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SP  3.1  Develop  Risk  Mitigation  Plans 

Develop  a  risk  mitigation  plan  in  accordance  with  the  risk 
management  strategy. 

A  critical  component  of  risk  mitigation  planning  is  developing  alternative 
courses  of  action,  workarounds,  and  fallback  positions,  and  a 
recommended  course  of  action  for  each  critical  risk.  The  risk  mitigation  plan 
for  a  given  risk  includes  techniques  and  methods  used  to  avoid,  reduce, 
and  control  the  probability  of  risk  occurrence;  the  extent  of  damage  incurred 
should  the  risk  occur  (sometimes  called  a  “contingency  plan”);  or  both. 

Risks  are  monitored  and  when  they  exceed  established  thresholds,  risk 
mitigation  plans  are  deployed  to  return  the  affected  effort  to  an  acceptable 
risk  level.  If  the  risk  cannot  be  mitigated,  a  contingency  plan  can  be 
invoked.  Both  risk  mitigation  and  contingency  plans  often  are  generated 
only  for  selected  risks  for  which  consequences  of  the  risks  are  high  or 
unacceptable.  Other  risks  may  be  accepted  and  simply  monitored. 

i  Options  for  handling  risks  typically  include  alternatives  such  as  the  following: 

:  •  Risk  avoidance:  changing  or  lowering  requirements  while  still  meeting  end  user  needs 
|  •  Risk  control:  taking  active  steps  to  minimize  risks 
:  •  Risk  transfer:  reallocating  requirements  to  lower  risks 

i  •  Risk  monitoring:  watching  and  periodically  reevaluating  the  risk  for  changes  in  assigned 

:  risk  parameters 

|  •  Risk  acceptance:  acknowledging  risk  but  not  taking  action 


Often,  especially  for  high-impact  risks,  more  than  one  approach  to  handling 
a  risk  should  be  generated. 

For  example,  in  the  case  of  an  event  that  disrupts  the  continuity  of  operations,  approaches 
to  risk  management  can  include  establishing  the  following: 

•  Resource  reserves  to  respond  to  disruptive  events 

•  Lists  of  available  backup  equipment 

•  Backups  to  key  staff 

•  Plans  for  testing  emergency  response  systems 

•  Posted  procedures  for  emergencies 

•  Disseminated  lists  of  key  contacts  and  information  resources  for  emergencies 


In  many  cases,  risks  are  accepted  or  watched.  Risk  acceptance  is  usually 
done  when  the  risk  is  judged  too  low  for  formal  mitigation  or  when  there 
appears  to  be  no  viable  way  to  reduce  the  risk.  If  a  risk  is  accepted,  the 
rationale  for  this  decision  should  be  documented.  Risks  are  watched  when 
there  is  an  objectively  defined,  verifiable,  and  documented  threshold  (e.g., 
for  cost,  schedule,  performance,  risk  exposure)  that  will  trigger  risk 
mitigation  planning  or  invoke  a  contingency  plan. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  evaluating  alternatives  and  selecting  solutions. 
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Thresholds  for  supplier  risks  that  affect  the  project  (e.g.,  schedule,  quality, 
risk  exposure  due  to  supplier  risks)  are  specified  in  the  supplier  agreement 
along  with  escalation  procedures  if  thresholds  are  exceeded. 

Adequate  consideration  should  be  given  early  to  technology 
demonstrations,  models,  simulations,  pilots,  and  prototypes  as  part  of  risk 
mitigation  planning. 

Example  Work  Products 

1 .  Documented  handling  options  for  each  identified  risk 

2.  Risk  mitigation  plans 

3.  Contingency  plans 

4.  List  of  those  who  are  responsible  for  tracking  and  addressing  each  risk 

5.  Disaster  recovery  or  continuity  plans 

Example  Supplier  Deliverables 

1 .  Documented  handling  options  for  each  identified  risk 

2.  Risk  mitigation  plans 

3.  Contingency  plans 

4.  List  of  those  who  are  responsible  for  tracking  and  addressing  each  risk 

5.  Disaster  recovery  or  continuity  plans 

Subpractices 

1 .  Determine  the  levels  and  thresholds  that  define  when  a  risk  becomes 
unacceptable  and  triggers  the  execution  of  a  risk  mitigation  plan  or 
contingency  plan. 

Risk  level  (derived  using  a  risk  model)  is  a  measure  combining  the  uncertainty  of 
reaching  an  objective  with  the  consequences  of  failing  to  reach  the  objective. 

Risk  levels  and  thresholds  that  bound  planned  or  acceptable  cost,  schedule,  or 
performance  should  be  clearly  understood  and  defined  to  provide  a  means  with  which 
risk  can  be  understood.  Proper  categorization  of  risk  is  essential  for  ensuring  an 
appropriate  priority  based  on  severity  and  the  associated  management  response. 
There  can  be  multiple  thresholds  employed  to  initiate  varying  levels  of  management 
response.  Typically,  thresholds  for  the  execution  of  risk  mitigation  plans  are  set  to 
engage  before  the  execution  of  contingency  plans. 

2.  Identify  the  person  or  group  responsible  for  addressing  each  risk. 

3.  Determine  the  costs  and  benefits  of  implementing  the  risk  mitigation 
plan  for  each  risk. 

Risk  mitigation  activities  should  be  examined  for  benefits  they  provide  versus 
resources  they  will  expend.  Just  like  any  other  design  activity,  alternative  plans  may 
need  to  be  developed  and  costs  and  benefits  of  each  alternative  assessed.  The  most 
appropriate  plan  is  selected  for  implementation. 

4.  Develop  an  overall  risk  mitigation  plan  for  the  project  to  orchestrate  the 
implementation  of  individual  risk  mitigation  and  contingency  plans. 
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The  complete  set  of  risk  mitigation  plans  may  not  be  affordable.  A  tradeoff  analysis 
should  be  performed  to  prioritize  risk  mitigation  plans  for  implementation. 

5.  Develop  contingency  plans  for  selected  critical  risks  in  the  event  their 
impacts  are  realized. 

Risk  mitigation  plans  are  developed  and  implemented  as  needed  to  proactively  reduce 
risks  before  they  become  problems.  Despite  best  efforts,  some  risks  can  be 
unavoidable  and  will  become  problems  that  affect  the  project.  Contingency  plans  can 
be  developed  for  critical  risks  to  describe  actions  a  project  can  take  to  deal  with  the 
occurrence  of  this  impact.  The  intent  is  to  define  a  proactive  plan  for  handling  the  risk. 
Either  the  risk  is  reduced  (mitigation)  or  addressed  (contingency).  In  either  event,  the 
risk  is  managed. 

Some  risk  management  literature  may  consider  contingency  plans  a  synonym  or 
subset  of  risk  mitigation  plans.  These  plans  also  can  be  addressed  together  as  risk 
handling  or  risk  action  plans. 

SP  3.2  Implement  Risk  Mitigation  Plans 

Monitor  the  status  of  each  risk  periodically  and  implement  the  risk 
mitigation  plan  as  appropriate. 

To  effectively  control  and  manage  risks  during  the  work  effort,  follow  a 
proactive  program  to  regularly  monitor  risks  and  the  status  and  results  of 
risk  handling  actions.  The  risk  management  strategy  defines  the  intervals  at 
which  risk  status  should  be  revisited.  This  activity  can  result  in  the  discovery 
of  new  risks  or  new  risk  handling  options  that  can  require  replanning  and 
reassessment.  In  either  event,  acceptability  thresholds  associated  with  the 
risk  should  be  compared  to  the  risk  status  to  determine  the  need  for 
implementing  a  risk  mitigation  plan. 

The  acquirer  shares  selected  risks  with  the  supplier.  Risks  associated  with 
the  acquisition  process  are  tracked  and  resolved  or  controlled  until 
mitigated.  This  monitoring  includes  risks  that  can  be  escalated  by  the 
supplier. 

Example  Work  Products 

1 .  Updated  lists  of  risk  status 

2.  Updated  assessments  of  risk  likelihood,  consequence,  and  thresholds 

3.  Updated  list  of  risk  handling  options 

4.  Updated  list  of  actions  taken  to  handle  risks 

5.  Risk  mitigation  plans  of  risk  handling  options 

Example  Supplier  Deliverables 

1 .  Updated  list  of  risk  status 

2.  Updated  assessments  of  risk  likelihood,  consequence,  and  thresholds 

3.  Updated  list  of  risk  handling  options 

4.  Updated  list  of  actions  taken  to  handle  risks 

5.  Risk  mitigation  plans 


346 


Risk  Management  (RSKM) 


CMMI  for  Acquisition,  Version  1.3 


Subpractices 

1.  Monitor  risk  status. 

After  a  risk  mitigation  plan  is  initiated,  the  risk  is  still  monitored.  Thresholds  are 
assessed  to  check  for  the  potential  execution  of  a  contingency  plan. 

A  mechanism  for  monitoring  should  be  employed. 

2.  Provide  a  method  for  tracking  open  risk  handling  action  items  to 
closure. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  managing  corrective  action  to  closure. 

3.  Invoke  selected  risk  handling  options  when  monitored  risks  exceed 
defined  thresholds. 

Often,  risk  handling  is  only  performed  for  risks  judged  to  be  high  and  medium.  The  risk 
handling  strategy  for  a  given  risk  can  include  techniques  and  methods  to  avoid, 
reduce,  and  control  the  likelihood  of  the  risk  or  the  extent  of  damage  incurred  should 
the  risk  occur,  or  both.  In  this  context,  risk  handling  includes  both  risk  mitigation  plans 
and  contingency  plans. 

Risk  handling  techniques  are  developed  to  avoid,  reduce,  and  control  adverse  impact 
to  project  objectives  and  to  bring  about  acceptable  outcomes  in  light  of  probable 
impacts.  Actions  generated  to  handle  a  risk  require  proper  resource  loading  and 
scheduling  in  plans  and  baseline  schedules.  This  replanning  should  closely  consider 
the  effects  on  adjacent  or  dependent  work  initiatives  or  activities. 

4.  Establish  a  schedule  or  period  of  performance  for  each  risk  handling 
activity  that  includes  a  start  date  and  anticipated  completion  date. 

5.  Provide  a  continued  commitment  of  resources  for  each  plan  to  allow 
the  successful  execution  of  risk  handling  activities. 

6.  Collect  performance  measures  on  risk  handling  activities. 
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SOLICITATION  AND  SUPPLIER  AGREEMENT  DEVELOPMENT 

A  Project  Management  Process  Area  at  Maturity  Level  2 


Purpose 


The  purpose  of  Solicitation  and  Supplier  Agreement  Development  (SSAD) 
is  to  prepare  a  solicitation  package,  select  one  or  more  suppliers  to  deliver 
the  product  or  service,  and  establish  and  maintain  the  supplier  agreement. 


Introductory  Notes 


The  Solicitation  and  Supplier  Agreement  Development  process  area 
provides  a  set  of  practices  that  enables  the  acquirer  to  initialize  and 
formalize  a  relationship  with  the  supplier  for  the  successful  execution  of  the 
project.  A  supplier  agreement  is  an  agreement  between  the  acquirer  and 
supplier.  This  agreement  can  be  a  contract,  license,  or  memorandum  of 
agreement.  The  acquired  product  or  service  is  delivered  to  the  acquirer 
from  the  supplier  according  to  the  supplier  agreement. 

A  supplier  agreement  created  using  these  practices  enables  the  acquirer  to 
monitor  and  control  supplier  activities  using  other  processes,  such  as  the 
Project  Monitoring  and  Control  and  Agreement  Management  processes. 

The  activities  described  in  Solicitation  and  Supplier  Agreement 
Development  apply  equally  to  initial  supplier  agreements  and  to  subsequent 
change  orders,  task  orders,  or  amendments  related  to  those  agreements. 

The  acquirer  is  responsible  for  establishing  and  maintaining  ground  rules 
for  communicating  with  the  supplier,  documenting  decisions,  and  resolving 
conflict  through  the  life  of  the  agreement.  The  acquirer  facilitates  these 
activities  with  relevant  stakeholders.  Roles  and  responsibilities  of  relevant 
stakeholders  during  the  interaction  with  suppliers  are  defined,  coordinated, 
and  adhered  to. 

The  specific  goals  and  specific  practices  of  this  process  area  build  on  each 
other.  The  Prepare  for  Solicitation  and  Supplier  Agreement  Development 
specific  goal  and  its  associated  specific  practices  identify  potential  suppliers 
and  develop  and  distribute  the  solicitation  package,  including  evaluation 
criteria  and  the  statement  of  work.  The  solicitation  package  is  developed 
using  work  products  from  other  processes  (e.g.,  requirements  and  design 
constraints  from  Acquisition  Requirements  Development  processes, 
supplier  project  and  technical  measures  and  objectives  from  Project 
Planning  and  Measurement  and  Analysis  processes). 

The  Select  Suppliers  specific  goal  and  its  associated  specific  practices  use 
work  products  from  the  preparation  of  the  solicitation  to  solicit  responses 
from  potential  suppliers,  evaluate  these  responses,  negotiate  with  potential 
suppliers,  and  select  a  supplier  who  can  best  deliver.  Subsequently,  the 
Establish  Supplier  Agreements  specific  goal  and  its  associated  specific 
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practices  are  used  to  establish  and  maintain  the  supplier  agreement.  In 
turn,  data  provided  by  the  supplier  and  documented  in  the  supplier 
agreement  (e.g.,  cost,  schedule,  risks)  are  used  by  Project  Planning 
processes  to  update  the  project  plan. 

This  process  area  contains  many  lists  of  examples  to  include  in  work 
products.  As  in  other  process  areas,  these  lists  are  not  all-inclusive  and  the 
acquirer  should  rely  on  other  related  lists  when  building  work  products. 
Considerations  for  supplier  agreement  content  are  described  throughout  the 
process  areas. 

Although  this  process  area  describes  acquisition  practices  for  a  project,  an 
acquirer  would  use  the  same  practices  in  establishing  a  supplier  agreement 
for  multiple  projects.  The  requirements  included  in  the  solicitation  package 
and  the  supplier  agreement  would  reflect  a  broader  scope,  and  the 
evaluation  and  selection  process  would  require  an  appropriate  level  of 
review  before  a  selection  is  made. 


Related  Process  Areas 


Refer  to  the  Agreement  Management  process  area  for  more  information 
about  ensuring  that  the  supplier  and  the  acquirer  perform  according  to  the 
terms  of  the  supplier  agreement. 

Refer  to  the  Acquisition  Requirements  Development  process  area  for  more 
information  about  developing  and  analyzing  customer  and  contractual 
requirements. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal  evaluation 
process  that  evaluates  identified  alternatives  against  established  criteria. 

Refer  to  the  Measurement  and  Analysis  process  area  for  more  information 
about  aligning  measurement  and  analysis  activities. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
establishing  estimates,  developing  a  project  plan,  and  obtaining 
commitment  to  the  plan. 

Refer  to  the  Requirements  Management  process  area  for  more  information 
about  managing  requirements  of  the  project’s  products  and  product 
components  and  identifying  inconsistencies  between  those  requirements 
and  the  project’s  plans  and  work  products. 
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Specific  Goal  and  Practice  Summary 

SG  1  Prepare  for  Solicitation  and  Supplier  Agreement  Development 
SP1.1  Identify  Potential  Suppliers 
SP  1 .2  Establish  a  Solicitation  Package 
SP  1 .3  Review  the  Solicitation  Package 
SP  1 .4  Distribute  and  Maintain  the  Solicitation  Package 
SG  2  Select  Suppliers 

SP  2.1  Evaluate  Proposed  Solutions 

SP  2.2  Establish  Negotiation  Plans 

SP  2.3  Select  Suppliers 

SG  3  Establish  Supplier  Agreements 

SP  3.1  Establish  an  Understanding  of  the  Agreement 

SP  3.2  Establish  the  Supplier  Agreement 

Specific  Practices  by  Goal 


SG  1 _ Prepare  for  Solicitation  and  Supplier  Agreement  Development _ 

Preparation  for  solicitation  and  supplier  agreement  development  is  performed. 

SP  1.1  Identify  Potential  Suppliers 

Identify  and  qualify  potential  suppliers. 

Consistent  with  internal  organizational  policy,  the  acquisition  strategy,  and 
project  scope  and  requirements,  the  acquirer  identifies  potential  suppliers  to 
receive  the  solicitation.  The  acquirer  can  identify  suppliers  from  a  variety  of 
sources  (e.g.,  staff,  international  seminars,  market  analysis  reports,  pre- 
established  schedules). 

In  some  organizations,  acquirers  may  solicit  proposals  from  a  limited 
number  of  suppliers  to  reduce  their  cost  and  efforts  for  the  solicitation. 
Acquirers  should,  however,  ensure  that  they  include  suppliers  who  are 
capable  of  meeting  the  requirements  and  that  a  sufficient  number  of 
suppliers  are  included  to  provide  a  competitive  environment.  This 
competition  enhances  the  leverage  of  the  acquirer  in  achieving  its 
objectives  (e.g.,  providing  different  approaches  to  meeting  requirements).  In 
some  cases,  the  organization  prequalifies  preferred  suppliers  from  which  an 
acquirer  can  choose  provided  the  preferred  suppliers  meet  the  specific 
needs  of  the  project.  Choosing  from  preferred  suppliers  can  greatly  reduce 
the  effort  and  time  required  for  solicitation. 

Depending  on  applicable  regulations  and  project  characteristics,  the 
acquirer  can  determine  to  pursue  a  sole-source  acquisition  rather  than  a 
competitive  bid.  Acquirers  should  document  the  rationale  for  determining 
potential  suppliers,  particularly  in  the  case  of  sole-source  selection. 

Example  Work  Products 

1 .  List  of  potential  suppliers  prepared  to  respond  to  the  solicitation 

Subpractices 

1 .  Develop  a  list  of  potential  suppliers. 
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To  develop  a  list  of  potential  suppliers,  the  acquirer  considers  which  suppliers  have 
experience  with  similar  systems  or  projects,  the  performance  the  acquirer  has 
experienced  with  suppliers  on  previous  projects,  which  suppliers  are  likely  to  provide 
the  capabilities  needed  for  the  project,  and  the  availability  of  critical  resources  to  staff 
and  support  the  project.  In  addition  to  assessing  supplier  capabilities,  a  risk 
assessment  is  prepared  on  the  suppliers’  financial  capabilities  (e.g.,  creditworthiness, 
financial  stability,  and  access  to  capital  and  the  impact  to  the  supplier  of  a  successful 
bid). 

2.  Communicate  with  potential  suppliers  concerning  the  forthcoming 
solicitation. 

The  acquirer  contacts  suppliers  to  outline  plans  for  the  solicitation,  including  the 
projected  schedule  for  releasing  the  solicitation  package  and  expected  dates  for 
responses  from  suppliers.  If  a  supplier  expresses  interest  in  responding  to  the 
solicitation,  the  appropriate  confidentiality  agreements  are  put  in  place. 

( - 

j  Typical  communication  to  candidate  suppliers  includes  the  following: 

j  •  Anticipated  scope  of  the  solicitation 
j  •  Schedule  for  release  of  the  solicitation  package 
:  •  Overall  project  schedule 

:  •  Approach  and  procedures  to  be  used  throughout  the  solicitation  process 
j  •  High-level  criteria  for  evaluating  proposal  responses 
:•  Required  supplier  qualifications 
:  •  Schedule  for  the  return  of  proposals 

j_  •  Date  when  the  supplier  must  indicate  if  it  will  or  will  not  participate  in  the  solicitation 

3.  Verify  participants  who  will  evaluate  supplier  proposals. 

4.  Verify  participants  in  supplier  negotiations. 

SP  1.2  Establish  a  Solicitation  Package 

Establish  and  maintain  a  solicitation  package  that  includes  the 
requirements  and  proposal  evaluation  criteria. 

Solicitation  packages  are  used  to  seek  proposals  from  potential  suppliers. 
The  acquirer  structures  the  solicitation  package  to  facilitate  an  accurate  and 
complete  response  from  each  potential  supplier  and  to  enable  an  effective 
comparison  and  evaluation  of  proposals. 

The  solicitation  package  includes  a  description  of  the  desired  form  of  the 
response,  the  relevant  statement  of  work  for  the  supplier,  and  required 
provisions  in  the  supplier  agreement  (e.g.,  a  copy  of  the  standard  supplier 
agreement  or  non-disclosure  provisions).  In  government  acquisitions,  some 
or  all  of  the  content  and  structure  of  the  solicitation  package  can  be  defined 
by  regulation. 
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The  solicitation  package  typically  contains  the  following: 

•  The  statement  of  work  for  the  supplier,  including  supplier  process,  product,  and  service 
level  measures 

•  Guidance  on  how  potential  suppliers  are  to  respond  to  the  solicitation  package 

•  A  description  of  the  evaluation  process  and  criteria  to  be  used  to  evaluate  proposals 

•  Documentation  requirements  to  submit  with  the  response  (e.g.,  project  plans) 

•  The  schedule  for  completing  the  solicitation  process 

•  Procedures  for  addressing  questions  and  contacts 


The  solicitation  package  is  rigorous  enough  to  ensure  consistent  and 
comparable  responses  but  flexible  enough  to  allow  consideration  of  supplier 
suggestions  for  better  ways  to  satisfy  requirements.  The  acquirer  can  invite 
suppliers  to  submit  a  proposal  that  is  wholly  responsive  to  the  request  for 
proposal  and  to  provide  a  proposed  alternative  solution  in  a  separate 
proposal. 

The  complexity  and  level  of  detail  of  the  solicitation  package  should  be 
consistent  with  the  value  of,  and  risk  associated  with,  the  planned 
acquisition.  In  some  cases,  the  solicitation  may  not  include  detailed 
requirements  (e.g.,  it  may  be  a  solicitation  for  development  of  detailed 
requirements  or  it  may  include  a  statement  of  objectives  to  provide  the 
supplier  greater  flexibility  in  addressing  the  scope  of  the  project). 

Proposal  and  supplier  evaluation  criteria  are  identified  and  documented. 

Example  Work  Products 

1 .  Solicitation  package 

2.  Supplier  and  proposal  evaluation  criteria 

Subpractices 

1 .  Develop  the  statement  of  work  for  the  supplier. 

The  statement  of  work  for  the  supplier  defines,  for  those  items  being  acquired,  the 
portion  of  the  project  scope  that  is  included  in  the  related  supplier  agreement.  The 
statement  of  work  for  a  supplier  is  developed  from  the  project  scope,  the  work 
breakdown  structure,  and  the  task  dictionary. 

The  statement  of  work  for  the  supplier  is  written  to  be  clear,  complete,  and  concise.  It 
describes  the  acquired  product  or  service  in  sufficient  detail  to  allow  prospective 
suppliers  to  determine  if  they  are  capable  of  providing  the  product  or  service. 
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Example  content  in  the  statement  of  work  for  the  supplier  includes  the  following: 

•  Project  objectives 

•  Requirements  (including  period  of  performance;  milestones;  work  location;  legal, 
statutory,  and  regulatory  requirements;  delivery  format;  quantities;  content 
requirements) 

•  Design  constraints 

•  Deliverables  and  rights  (e.g.,  work  breakdown  structure  of  the  supplier’s  work, 
detailed  design,  test  results) 

•  An  overview  of  the  project  with  sufficient  information  for  the  supplier  to  understand 
the  project  environment  and  risks 

•  Expectations  of  the  supplier’s  transition  of  the  product  to  operations  and  support 

•  Expectations  for  process,  product,  and  service  level  measures  and  reports  that 
provide  the  acquirer  visibility  into  supplier  progress  and  performance 

•  Collateral  services  required  (e.g.  study  reports,  development  of  training  materials, 
delivery  of  training  to  end  users) 

•  Acquirer  specified  standard  processes  for  the  project  (e.g.,  configuration 
management,  issue  escalation  and  resolution,  corrective  action  for 
nonconformances,  change  management) 

•  The  type  of  reviews  to  be  conducted  with  the  supplier  and  other  communication 
processes  and  procedures 

•  Product  acceptance  criteria  and  required  supplier  involvement  in  the  acquirer’s 
validation  and  acceptance  activities 

•  Post-project  support 


The  statement  of  work  for  the  supplier  can  be  revised  and  refined  as  it  moves  through 
the  solicitation,  negotiation,  and  supplier  agreement  development  processes  until  it  is 
incorporated  into  a  signed  supplier  agreement.  For  example,  a  prospective  supplier 
can  suggest  a  more  efficient  approach  or  a  less  costly  product  than  what  was  originally 
specified. 

2.  Specify  the  process,  product,  and  service  level  measures  for 
acceptance. 

The  measures  specify  customer  expectations  and  threshold  values  and  are  used  to 
monitor  the  supplier  and  gauge  the  supplier’s  adherence  to  requirements. 

Service  levels  are  an  indicator  of  service  delivery  performance  relative  to  an  agreed-on 
service  level  measure.  Service  levels  are  designed  to  support  the  acquisition  strategy. 
(See  the  definitions  of  “service  level”  and  “measure”  in  the  glossary.) 

3.  Develop  supplier  evaluation  and  proposal  evaluation  criteria. 

Evaluation  criteria  are  developed  and  used  to  rate  or  score  proposals.  Evaluation 
criteria  are  included  in  the  solicitation  package.  Evaluation  criteria  can  be  limited  to 
purchase  price  if  the  acquisition  item  is  readily  available  from  a  number  of  acceptable 
suppliers.  Purchase  price  in  this  context  includes  both  the  cost  of  the  item  and  ancillary 
expenses  such  as  delivery.  Other  selection  criteria  can  be  identified  and  documented 
to  support  an  evaluation  of  a  more  complex  product  or  service  (e.g.,  the  individuals 
identified  in  the  Project  Planning  resource  plan  develop  and  document  criteria  for 
evaluating  potential  suppliers  and  their  proposals). 
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Examples  of  areas  used  to  evaluate  a  potential  supplier’s  ability  and  proposal  include 

the  following: 

•  Compliance  to  stated  requirements  contained  in  the  solicitation  package 

•  Experience  with  similar  products  or  services  (e.g.,  data  on  most  recent  similar 
projects  with  the  associated  cost,  schedule,  and  performance  and  the  degree  to 
which  requirements  were  fulfilled) 

•  Familiarity  with  acquirer  processes,  the  technical  environment,  and  the  core 
business 

•  Total  ownership  and  lifecycle  costs 

•  Technical  capability  (e.g.,  expected  compliance  to  functional  and  quality  attribute 
requirements,  criteria  given  the  architecture  and  technical  solution  proposed) 

•  Management,  development,  and  delivery  processes  and  procedures 

•  Proposed  technical  methodologies,  techniques,  solutions,  and  services 

•  Financial  capability 

•  Production  capacity  and  interest  (e.g.,  staff  available  to  perform  the  effort,  available 
facilities,  other  available  resources) 

•  Business  size  and  type 

•  Intellectual  property  and  proprietary  rights 


4.  Document  the  proposal  content  that  suppliers  must  submit  with  their 
response. 
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Examples  of  proposal  content  required  for  suppliers  to  submit  include  the  following: 

•  Compliance  with  requirements 

•  References,  company  overview,  and  case  studies 

•  Evidence  of  the  supplier’s  organizational  processes  on  which  supplier  processes 
for  the  project  will  be  based  and  the  commitment  to  execute  those  processes  from 
project  inception 

•  Plan  describing  how  the  supplier  will  carry  out  the  scope  and  content  of  the 
solicitation  package,  including  any  improvements  of  execution  capability  over  the 
duration  of  the  supplier  agreement 

•  Understanding  of  the  size  and  complexity  of  the  requested  work  based  on 
requirements 

•  The  pricing  and  compensation  methodology  that  enables  calculation  of  charges  for 
the  services  being  provided  to  the  acquirer  pursuant  to  supplier  agreement  terms 
and  conditions,  including  taxes,  credits,  foreign  currency  translation,  licenses, 
pass-through  costs,  and  travel  reimbursements 

•  Pricing  and  compensation  schedules  that  provide  for  charges  for  the  products  and 
services  provided,  including  frequency,  term,  and  pricing  type  (e.g.,  fixed  price, 
lump  sum,  time  and  materials)  as  well  as  rate  cards,  and  a  skills  matrix 

•  Compliance  with  acquirer  travel  reimbursement  policies 

•  References  and  experience  validating  the  capability  of  the  supplier’s  proposed 
approach  to  meet  proposed  funding,  schedule,  and  quality  targets 

•  Risk  management  plan  describing  how  the  supplier  will  periodically  manage  risks 
throughout  the  life  of  the  project  and  how  risks  documented  in  the  solicitation 
package  will  be  managed 

•  Methods  for  early  defect  identification  and  the  prevention  of  defects  in  delivered 
products 

•  The  supplier’s  approach  to  assuring  the  quality  of  the  product 

•  Approach  to  the  escalation  and  resolution  of  issues 

•  Description  of  the  supplier’s  proposed  use  of  COTS  products  and  rationale  for  the 
supplier’s  confidence  that  COTS  products  can  achieve  the  requirements 

•  Description  of  the  supplier’s  proposed  reuse  of  previously  developed  hardware  and 
software,  rationale  for  the  supplier’s  confidence  that  re-use  can  be  achieved,  and 
associated  information  about  data  rights 

•  Approach  to  providing  visibility  of  development  progress  and  costs  at  a  level 
appropriate  for  the  type  of  agreement  and  commensurate  with  the  degree  of  risk 

•  Retention  of  critical  staff  during  the  project 

•  Identification  of  work  to  be  performed  by  subcontractors 
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5.  Incorporate  the  acquirer’s  (standard)  supplier  agreement,  terms  and 
conditions,  and  additional  information  into  the  solicitation  package. 

I  Supplier  agreement  terms  and  conditions  typically  include  the  following: 
i  •  Recitals 

i  •  Deliverables  and  rights 
i  •  Compensation  and  payments 
:  •  Confidentiality 
i  •  Privacy  statements 

:  •  Continuous  improvement  and  best  practices 
i  •  Exclusive  services,  key  staff,  supplier  staff  at  acquirer  sites 
i  •  Information  gathering  practices  and  ethical  representation 
I  •  Force  majeure 
:  •  Term 

I  •  Termination  for  insolvency,  breach,  or  non-performance 
i  •  Termination  for  convenience 
:  •  Termination  assistance 
:  •  Indemnification 
i  •  Insurance 
i  •  Right  to  audit 
!  •  Notices 
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Typical  considerations  for  additional  instructions  and  general  information  to  help  the 
supplier  when  responding  to  the  solicitation  package  include  the  following: 

•  Submission  of  intent  to  submit  proposal 

•  Submission  due  date,  time,  and  destination 

•  Number  of  proposal  copies  that  must  be  submitted 

•  Proposal  format 

•  Non-complying  proposals 

•  Proposal  ownership 

•  Bidder  inquiries 

•  Key  dates  and  activities 

•  Discretionary  selection  and  potential  modifications  of  the  solicitation  process 

•  No  implied  offer 

•  Response  constitutes  an  offer  to  do  business 

•  Confidentiality  of  information 

•  Publicity 

•  Use  of  subcontractors 

•  Due  diligence 

•  Incurred  costs 

•  Language  requirements 

•  Statutory  units 

•  Warranty  provisions 

•  Licensing  provisions 


SP  1.3  Review  the  Solicitation  Package 

Review  the  solicitation  package  with  relevant  stakeholders  to 
obtain  commitment  to  the  approach. 

The  solicitation  package  is  reviewed  with  stakeholders  to  ensure 
requirements  have  been  accurately  and  sufficiently  stated  so  that  the 
solicitation  can  lead  to  a  manageable  agreement.  The  acquirer  establishes 
traceability  between  requirements  and  the  solicitation  package.  Suppliers 
can  be  included  as  stakeholders  in  the  review  of  the  solicitation  package. 
The  acquirer  wants  the  solicitation  package  to  attract  a  variety  of  responses 
and  encourage  competition.  The  acquirer  also  wants  the  solicitation 
package  to  be  legally  inclusive  of  all  qualified  suppliers. 

Refer  to  the  Perform  Peer  Reviews  specific  goal  in  the  Acquisition 
Verification  process  area  for  more  information  about  conducting  peer 
reviews. 

The  acquirer  can  use  standard  templates  and  checklists  to  verify  that  the 
necessary  components  (e.g.,  skills,  standards,  verification  and  validation 
methods,  measures,  acceptance  criteria)  are  covered  in  the  solicitation 
package. 
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SP  1.4 


Refer  to  the  Organizational  Process  Definition  process  area  for  more 
information  about  establishing  organizational  process  assets. 

The  independent  cost  and  schedule  estimates  for  the  supplier’s  project 
work  are  reviewed. 

Example  Work  Products 

1 .  Record  of  the  reviews  of  the  solicitation  package 

Distribute  and  Maintain  the  Solicitation  Package 

Distribute  the  solicitation  package  to  potential  suppliers  for  their 
response  and  maintain  the  package  throughout  the  solicitation. 

The  solicitation  package  is  distributed  to  potential  suppliers  in  accordance 
with  approved  acquirer  solicitation  policies  and  procedures. 

Refer  to  the  Project  Monitoring  and  Control  process  area  for  more 
information  about  monitoring  the  project  against  the  plan. 

Refer  to  the  Project  Planning  process  area  for  more  information  about 
establishing  and  maintaining  plans  that  define  project  activities. 

Example  Work  Products 

1 .  Responses  to  supplier  questions 

2.  Amendments  to  the  solicitation  package 

Example  Supplier  Deliverables 

1.  Supplier  proposals 

2.  Supplier  questions  and  requests  for  clarification 

Subpractices 

1 .  Finalize  a  list  of  potential  suppliers. 

2.  Distribute  the  solicitation  package  to  potential  suppliers. 

3.  Document  and  respond  to  supplier  questions  according  to  the 
instructions  in  the  solicitation  package. 

Verify  that  all  potential  suppliers  have  equal  access  and  opportunity  to  provide 
feedback  on  the  solicitation  package.  Provide  the  opportunity  for  selected  potential 
suppliers  and  stakeholders  to  clarify  points  of  ambiguity  in  requirements  as  well  as 
disconnects  or  concerns  with  requirements. 

4.  Acknowledge  the  receipt  of  supplier  proposals  according  to  the 
schedule  identified  in  the  solicitation  package. 

5.  Verify  conformance  to  requirements  and  completeness  of  supplier 
responses. 

The  suppliers  should  be  contacted  for  corrective  action  if  the  response  is  non- 
conforming  or  incomplete. 

6.  Issue  amendments  to  the  solicitation  package  when  changes  are  made 
to  the  solicitation. 
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SG  2 _ Select  Suppliers _ 

Suppliers  are  selected  using  a  formal  evaluation. 

Suppliers  are  selected  according  to  approved  acquirer  selection  policies 
and  procedures. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal  evaluation 
process  that  evaluates  identified  alternatives  against  established  criteria. 

SP  2.1  Evaluate  Proposed  Solutions 

Evaluate  proposed  solutions  according  to  documented  proposal 
evaluation  criteria. 

Proposals  submitted  in  response  to  solicitation  packages  are  evaluated  in 
accordance  with  an  overall  established  timeline,  preliminary  project  plans, 
and  proposal  evaluation  criteria.  Proposal  evaluation  criteria  are  used  to 
evaluate  potential  supplier  responses  to  the  solicitation.  Evaluation  results 
and  decision-making  notes  (e.g.,  advantages  and  disadvantages  of 
potential  suppliers,  scoring  against  criteria)  should  be  documented  and 
maintained. 

For  task  orders  or  changes  in  the  terms  of  an  existing  supplier  agreement, 
the  acquirer  uses  documented  evaluation  criteria  to  evaluate  task  order 
responses  or  proposed  changes  to  terms  of  the  agreement.  In  a  sole- 
source  or  change  order  environment,  this  practice  is  critical  to  enable 
relevant  stakeholder  understanding  of  the  intent  of  the  effort  or  changes 
before  placing  additional  work  against  the  supplier  agreement. 

Example  Work  Products 

1 .  Clarification  correspondence  between  the  acquirer  and  potential 
suppliers 

2.  Evaluation  results  and  rationale 

3.  List  of  candidate  suppliers 

Example  Supplier  Deliverables 

1 .  Proposal  revisions  based  on  clarifications 

2.  Supplier  documentation  of  their  approach  to  the  project  work,  their 
capabilities,  and  a  preliminary  technical  solution 

Subpractices 

1 .  Distribute  supplier  proposals  to  individuals  identified  by  the  acquirer  to 
perform  the  evaluation. 

2.  Schedule  an  acquirer  evaluation  review  of  supplier  proposals  to 
consolidate  questions,  concerns,  and  issues. 

3.  Schedule  supplier  presentations. 

4.  Confirm  the  mutual  understanding  of  the  statement  of  work. 
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A  good  practice  is  to  compare  the  supplier’s  estimates  to  the  estimates  developed  in 
project  planning;  this  comparison  provides  a  means  to  determine  if  there  is  a  mutual 
understanding  of  requirements  and  the  associated  work  to  fulfill  them. 

5.  Evaluate  supplier  proposals  and  document  findings. 

6.  Execute  due  diligence. 

Due  diligence  provides  an  opportunity  for  the  acquirer  to  further  clarify  requirements, 
particularly  the  ones  related  to  the  acquirer’s  existing  environment  and  products  in  use. 
Potential  suppliers  ask  questions  and  gain  understanding,  which  enables  them  to 
make  realistic  proposals.  It  also  enables  the  acquirer  to  gain  insight  into  the  capability 
of  the  potential  suppliers’  proposed  solutions  to  meet  requirements. 

Due  diligence  helps  to  eliminate  assumptions  and  replace  them  with  facts,  to  identify 
and  document  risks  and  their  mitigation  plans  or  effect  on  the  agreement,  and  to  list 
issues  and  dependencies  between  the  acquirer  and  supplier  to  include  in  the 
agreement. 

j  Examples  of  typical  due  diligence  activities  include  the  following: 

j  •  Reviews  of  requirements  with  the  current  supplier  or  acquirer  resources 
j  maintaining  the  products  or  providing  the  services 

j  •  Reviews  of  interfaces  of  a  system  with  other  systems  maintained  by  the  acquirer 
i  •  Reviews  and  validations  of  supplier  references 
:  •  Reviews  of  the  operating  environment’s  facilities  and  capabilities 
:  •  Reviews  of  regulatory  and  security  requirements 
\  •  Reviews  of  supplier  capabilities 

7.  Document  candidate  supplier  recommendations  based  on  the  proposal 
evaluation. 

SP  2.2  Establish  Negotiation  Plans 

Establish  and  maintain  negotiation  plans  to  use  in  completing  a  supplier 
agreement. 

The  acquirer  develops  and  refines  a  negotiation  plan  for  each  of  the 
candidate  suppliers  based  on  the  evaluation  of  the  suppliers  and  their 
proposals. 

The  proposal  evaluation  and  negotiations  with  suppliers  provide  the  basis 
for  selecting  the  supplier  best  able  to  meet  the  requirements  of  the 
solicitation. 

The  size  of  a  negotiation  team  depends  on  the  size  and  complexity  of  the 
project.  Typically,  the  team  is  led  by  acquirer  management  and  includes 
individuals  who  have  detailed  knowledge  of  the  statement  of  work 
documented  in  the  solicitation  package.  The  negotiation  team  is  typically 
supported  by  a  legal  staff,  a  financial  analyst,  purchasing,  and  the  project 
manager. 

Negotiations  between  acquirers  and  suppliers  can  be  restricted  by 
regulation.  Review  all  regulations  affecting  negotiations  before  entering  into 
them  with  a  supplier. 
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Examples  of  items  included  in  a  negotiation  plan  include  the  following: 

•  Roles  and  responsibilities  of  negotiation  team  members 

•  Key  issues  to  be  negotiated  from  supplier  responses 

•  Negotiation  “levers”  and  where  and  when  they  should  be  used 

•  The  sequence  of  events  to  negotiate  issues 

•  Fail-back  or  compromise  positions  as  necessary  on  given  issues  (possible  concessions 
and  trades) 

•  List  of  items  that  are  non-negotiable 

•  External  factors  that  could  influence  negotiations;  (e.g.,  other  pending  deals  and 
strategic  plans) 

•  Prior  experiences  with  supplier  agreements  to  discover  previous  positions  and  issues 
(and  negotiating  styles) 

•  Schedule  and  sequence  of  supplier  negotiation  meetings 

•  Objectives  for  each  negotiating  session 

•  Risks,  consequences,  and  mitigation  alternatives 


Example  Work  Products 

1 .  Negotiation  plan  for  each  candidate  supplier 

SP  2.3  Select  Suppliers 

Select  suppliers  based  on  an  evaluation  of  their  ability  to  meet 
specified  requirements  and  established  criteria. 

Proposal  evaluation  results  are  used  to  finalize  a  supplier  selection  based 
on  the  outcome  of  negotiations  or  responses  to  acquirer  questions  provided 
by  potential  suppliers.  Negotiations  enable  the  acquirer  to  select  the  best 
supplier  for  the  project.  In  some  cases,  the  acquirer  can  take  the  top  two 
proposals  and  use  negotiations  to  make  the  final  selection  decision. 

Evaluation  results  and  negotiation  results  support  the  selection  decision  or 
cause  the  acquirer  to  take  other  action  as  appropriate.  If  the  return  on 
investment  is  not  sufficient,  the  acquirer  can  decide  to  defer  or  cancel  the 
project. 

Example  Work  Products 

1.  Revisions  due  to  negotiations 

2.  Supplier  selection  decision 

3.  Evaluation  reports 

Subpractices 

1 .  Evaluate  supplier  proposals. 

The  evaluation  of  supplier  proposals  includes  an  evaluation  of  past  performance.  The 
acquirer’s  evaluation  of  past  supplier  performance  is  carried  out  primarily  to  document 
the  supplier’s  competency  relative  to  performing  similar  work  on  the  project  or  other 
projects. 
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2.  Negotiate  with  suppliers  to  determine  the  best  fit  for  the  project. 

Negotiate  with  the  selected  supplier  or  candidate  suppliers  to  resolve  issues  identified 
during  due  diligence  and  to  address  remaining  issues  with  requirements.  Revise 
requirements  to  be  fulfilled  by  the  supplier  as  appropriate. 

3.  Select  a  supplier  to  be  awarded  the  supplier  agreement. 

Refer  to  the  Decision  Analysis  and  Resolution  process  area  for  more 
information  about  analyzing  possible  decisions  using  a  formal 
evaluation  process  that  evaluates  identified  alternatives  against 
established  criteria. 

4.  Document  the  selection. 

SG  3 _ Establish  Supplier  Agreements _ 

Supplier  agreements  are  established  and  maintained. 

A  supplier  agreement  is  established  and  maintained  based  on  the  supplier 
selection  decision. 

SP  3.1  Establish  an  Understanding  of  the  Agreement 

Establish  and  maintain  a  mutual  understanding  of  the  agreement 
with  selected  suppliers  and  end  users  based  on  acquisition  needs 
and  the  suppliers’  proposed  approaches. 

To  assist  in  establishing  a  mutual  understanding  of  the  agreement,  the 
acquirer  should  review  requirements  of  the  agreement  with  the  supplier  and 
end  user.  Because  points  of  clarification  and  ambiguities  can  arise  after 
award  of  the  supplier  agreement,  the  acquirer  should  work  with  the  supplier 
and  end  user  to  ensure  that  a  mutual  understanding  is  maintained  through 
the  life  of  the  project  (e.g.,  supplier  workshops,  executive  meetings). 

Example  Work  Products 

1 .  Correspondence  clarifying  elements  of  the  agreement 

2.  Frequently  asked  questions  (for  use  with  end  users  and  other 
suppliers) 

SP  3.2  Establish  the  Supplier  Agreement 

Establish  and  maintain  the  supplier  agreement. 

The  agreement  can  be  either  a  stand-alone  agreement  or  part  of  a  master 
agreement.  When  part  of  a  master  agreement,  the  project  agreement  can 
be  an  addendum,  work  order,  or  service  request  to  the  master  agreement. 

Example  Work  Products 

1 .  Supplier  agreement  (including  terms  and  conditions) 

Subpractices 

1 .  Establish  the  supplier  agreement. 
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Supplier  agreement  provisions  typically  include  the  following: 

•  The  statement  of  work,  specification,  terms  and  conditions,  list  of  deliverables, 
schedule,  budget,  and  acceptance  process 

•  Product  acceptance  criteria  to  be  satisfied  by  the  supplier 

•  Mechanisms  and  deliverables  that  provide  sufficient  data  to  allow  the  acquirer  to 
evaluate  and  analyze  acquired  products 

•  Which  acquirer  and  supplier  representatives  are  responsible  and  authorized  to 
make  changes  to  the  supplier  agreement 

•  How  requirements  changes  and  changes  to  the  supplier  agreement  are 
determined,  communicated,  and  addressed 

•  Standards  and  procedures  to  be  followed  (e.g.,  configuration  management, 
escalation,  nonconformances,  conflicts,  issues) 

•  Requirements  for  the  supplier  to  establish  a  corrective  action  system  that  includes 
a  change  control  process  for  rework  and  reevaluation 

•  Critical  dependencies  between  the  acquirer  and  supplier 

•  Documentation  of  what  the  acquirer  will  provide  to  the  supplier  (e.g.,  facilities, 
tools,  software,  documentation,  services) 

•  Analysis  methods  and  acceptance  criteria  for  designated  supplier  deliverables 

•  The  types  of  reviews  to  be  conducted  with  the  supplier 

•  The  supplier’s  responsibilities  to  execute  corrective  actions  when  initiated  by 
project  monitoring  and  control  processes 

•  Non-hire  and  non-compete  clauses 

•  Confidentiality,  non-disclosure,  and  intellectual  capital  clauses  pertaining  to 
process  and  product  quality  assurance,  measurement  data,  and  staff  who  would 
perform  audits  or  are  authorized  to  validate  measurement  data 

•  The  supplier’s  responsibilities  for  preparing  the  site  and  training  the  support  and 
operations  organizations  according  to  acquirer  specified  standards,  tools,  and 
methods 

•  The  supplier’s  responsibilities  for  ongoing  maintenance  and  support  of  acquired 
products  and  their  role  as  a  stakeholder 

•  Requirements  for  the  supplier  to  maintain  bi-directional  traceability  to  requirements 
provided  in  the  supplier  agreement 

•  Requirements  for  the  supplier  to  be  involved  in  deployment  as  necessary 

•  Warranty,  ownership,  usage,  and  data  rights  for  acquired  products 

•  Schedule  for  supplier  compensation 

•  Security  and  legal  penalty  recoveries 

•  Dispute  resolution  procedures 


2.  Verify  that  all  parties  to  the  agreement  understand  and  agree  to  all 
requirements  by  signing  the  supplier  agreement. 

The  acquirer  should  ensure  that  the  supplier  makes  a  commitment  in  the  agreement  to 
execute  its  proposed  processes. 

3.  Notify  the  suppliers  not  selected  for  the  award. 

4.  Communicate  the  supplier  agreement  in  the  organization  as  required. 


364 


Solicitation  and  Supplier  Agreement  Development  (SSAD) 


CMMI  for  Acquisition,  Version  1.3 


5.  Maintain  the  supplier  agreement  as  required. 

After  establishment  of  the  supplier  agreement,  the  acquirer  can  find  requirements  that 
are  no  longer  optimal  or  applicable  based  on  the  supplier’s  progress  or  environment 
changes.  Examples  include  the  availability  of  new  technology,  overly  burdensome 
documentation,  and  reporting  requirements.  Changes  to  supplier  agreements  can  also 
occur  when  the  supplier’s  processes  or  products  fail  to  meet  agreed-to  criteria. 

The  supplier  agreement  and  project  documents  should  be  revised  to  reflect  changes  in 
conditions  as  appropriate.  This  includes  updating  cost,  schedule,  and  budget 
documents  as  needed. 

All  changes  are  formally  documented  and  approved  by  both  the  acquirer  and  supplier 
before  being  implemented  by  this  specific  practice.  Approved  change  requests  can 
include  modifications  to  terms  and  conditions  of  the  supplier  agreement,  including  the 
statement  of  work,  pricing,  and  the  descriptions  of  products,  services,  or  results  to  be 
acquired. 

Refer  to  the  Configuration  Management  process  area  for  more 
information  about  tracking  and  controlling  changes. 

6.  Ensure  that  all  records  related  to  the  supplier  agreement  are  stored, 
managed,  and  controlled  for  future  use. 
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Appendix  B:  Acronyms 


ANSI 

American  National  Standards  Institute 

ACQ 

Acquisition  constellation 

AM 

Agreement  Management  (process  area) 

API 

application  program  interface 

ARC 

Appraisal  Requirements  for  CMMI 

ARD 

Acquisition  Requirements  Development  (process  area) 

ASR 

alternative  system  review 

ATM 

Acquisition  Technical  Management  (process  area) 

AVAL 

Acquisition  Validation  (process  area) 

AVER 

Acquisition  Verification  (process  area) 

CAR 

Causal  Analysis  and  Resolution  (process  area) 

CCB 

configuration  control  board 

CDR 

critical  design  review 

CL 

capability  level 

CM 

Configuration  Management  (process  area) 

CMF 

CMMI  Model  Foundation 

CMM 

Capability  Maturity  Model 

CMMI 

Capability  Maturity  Model  Integration 

CMMI-ACQ 

CMMI  for  Acquisition 

CMMI-DEV 

CMMI  for  Development 

CMMI-SVC 

CMMI  for  Services 

Acronyms 
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CMU 

CobiT 

COTS 

CPI 

CPM 

DAR 

DHS 

DEV 

DoD 

EIA 

EIA/IS 

EVM 

EVMS 

FCA 

FMEA 

GG 

GP 

IBM 

IBR 

IDEAL 

IEC 

IEEE 

INCOSE 

IPD-CMM 

IPM 


Carnegie  Mellon  University 

Control  Objectives  for  Information  and  related  Technology 
commercial  off-the-shelf 
cost  performance  index 
critical  path  method 

Decision  Analysis  and  Resolution  (process  area) 

Department  of  Homeland  Security 

Development  constellation 

Department  of  Defense 

Electronic  Industries  Alliance 

Electronic  Industries  Alliance/Interim  Standard 

earned  value  management 

earned  value  management  system 

functional  configuration  audit 

failure  mode  and  effects  analysis 

generic  goal 

generic  practice 

International  Business  Machines 
integrated  baseline  review 

Initiating,  Diagnosing,  Establishing,  Acting,  Learning 
International  Electrotechnical  Commission 
International  Electrical  and  Electronics  Engineers 
International  Council  on  Systems  Engineering 
Integrated  Product  Development  Capability  Maturity  Mode 
Integrated  Project  Management  (process  area) 
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ISO 

International  Organization  for  Standardization 

ISO/IEC 

International  Organization  for  Standardization  and 
International  Electrotechnical  Commission 

IT 

information  technology 

ITIL 

Information  Technology  Infrastructure  Library 

ITR 

initial  technical  review 

MA 

Measurement  and  Analysis  (process  area) 

MDD 

Method  Definition  Document 

ML 

maturity  level 

NDIA 

National  Defense  Industrial  Association 

OID 

Organizational  Innovation  and  Deployment  (former 
process  area) 

OPD 

Organizational  Process  Definition  (process  area) 

OPF 

Organizational  Process  Focus  (process  area) 

OPM 

Organizational  Performance  Management  (process  area) 

OPP 

Organizational  Process  Performance  (process  area) 

OT 

Organizational  Training  (process  area) 

OTRR 

operational  test  readiness  review 

P-CMM 

People  Capability  Maturity  Model 

PA 

process  area 

PCA 

physical  configuration  audit 

PDR 

preliminary  design  review 

PERT 

Program  Evaluation  and  Review  Technique 

PMC 

Project  Monitoring  and  Control  (process  area) 

PP 

Project  Planning  (process  area) 

PPQA 

Process  and  Product  Quality  Assurance  (process  area) 

Acronyms 
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PRR 

QFD 

QPM 

REQM 

RSKM 

SA-CMM 

SCAMPI 

SECAM 

SECM 

SEI 

SFR 

SG 

SP 

SPI 

SRR 

SSAD 

SSD 

SSE-CMM 

SVC 

SVR 

SW-CMM 

SW 

TRA 


production  readiness  review 

Quality  Function  Deployment 

Quantitative  Project  Management  (process  area) 

Requirements  Management  (process  area) 

Risk  Management  (process  area) 

Software  Acquisition  Capability  Maturity  Model 

Standard  CMMI  Appraisal  Method  for  Process 
Improvement 

Systems  Engineering  Capability  Assessment  Model 

Systems  Engineering  Capability  Model 

Software  Engineering  Institute 

system  functional  review 

specific  goal 

specific  practice 

schedule  performance  index 

system  requirements  review 

Solicitation  and  Supplier  Agreement  Development 
(process  area) 

Service  System  Development  (process  area  in  CMM- 
SVC) 

Systems  Security  Engineering  Capability  Maturity  Model 

Services  constellation 

system  verification  review 

Capability  Maturity  Model  for  Software  or  Software 
Capability  Maturity  Model 

software 

technology  readiness  assessment 
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TRR 


test  readiness  review 


WBS 


work  breakdown  structure 


Acronyms 
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Appendix  C:  CMMI  Version  1.3  Project 
Participants 


Many  talented  people  were  part  of  the  product  team  that  developed  CMMI 
Version  1 .3  models.  Listed  below  are  those  who  participated  in  one  or  more 
of  the  following  teams  during  the  development  of  CMMI  Version  1 .3.  The 
organizations  listed  by  members’  names  are  those  they  represented  at  the 
time  of  their  team  membership. 

The  following  are  the  primary  groups  involved  in  the  development  of  this 
model: 

•  CMMI  Steering  Group 

•  CMMI  for  Services  Advisory  Group 

•  CMMI  VI  .3  Coordination  Team 

•  CMMI  VI  .3  Configuration  Control  Board 

•  CMMI  VI  .3  Core  Model  Team 

•  CMMI  VI  .3  Translation  Team 

•  CMMI  VI  .3  High  Maturity  Team 

•  CMMI  VI  .3  Acquisition  Mini  Team 

•  CMMI  VI  .3  Services  Mini  Team 

•  CMMI  VI  .3  SCAMPI  Upgrade  Team 

•  CMMI  VI  .3  Training  Teams 

•  CMMI  VI  .3  Quality  Team 


CMMI  Steering  Group 

The  CMMI  Steering  Group  guides  and  approves  the  plans  of  the  CMMI 
Product  Team,  provides  consultation  on  significant  CMMI  project  issues, 
ensures  involvement  from  a  variety  of  interested  communities,  and 
approves  the  final  release  of  the  model. 

Steering  Group  Members _ 

•  Alan  Bemish,  US  Air  Force 

•  Anita  Carleton,  Software  Engineering  Institute 

•  Clyde  Chittister,  Software  Engineering  Institute 

•  James  Gill,  Boeing  Integrated  Defense  Systems 
.  John  C.  Kelly,  NASA 

•  Kathryn  Lundeen,  Defense  Contract  Management  Agency 
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•  Larry  McCarthy,  Motorola,  Inc. 

•  Lawrence  Osiecki,  US  Army 

•  Robert  Rassa,  Raytheon  Space  and  Airborne  Systems  (lead) 

•  Karen  Richter,  Institute  for  Defense  Analyses 

•  Joan  Weszka,  Lockheed  Martin  Corporation 

•  Harold  Wilson,  Northrop  Grumman 

•  Brenda  Zettervall,  US  Navy 

Ex-Officio  Steering  Group  Members 

•  Mike  Konrad,  Software  Engineering  Institute 

•  Susan  LaFortune,  National  Security  Agency 

•  David  (Mike)  Phillips,  Software  Engineering  Institute 

Steering  Group  Support _ 

•  Mary  Beth  Chrissis,  Software  Engineering  Institute  (CCB) 

•  Eric  Hayes,  Software  Engineering  Institute  (secretary) 

•  Rawdon  Young,  Software  Engineering  Institute  (Appraisal  program) 


CMMI  for  Services  Advisory  Group 

The  Services  Advisory  Group  provides  advice  to  the  product  development 
team  about  service  industries. 

•  Brandon  Buteau,  Northrop  Grumman  Corporation 

•  Christian  Carmody,  University  of  Pittsburgh  Medical  Center 

•  Sandra  Cepeda,  Cepeda  Systems  &  Software  Analysis/RDECOM  SED 

•  Annie  Combelles,  DNV  IT  Global  Services 

•  Jeff  Dutton,  Jacobs  Technology,  Inc. 

•  Eileen  Forrester,  Software  Engineering  Institute 

•  Craig  Hollenbach,  Northrop  Grumman  Corporation  (lead) 

•  Bradley  Nelson,  Department  of  Defense 

•  Lawrence  Osiecki,  US  Army  ARDEC 

•  David  (Mike)  Phillips,  Software  Engineering  Institute 

•  Timothy  Salerno,  Lockheed  Martin  Corporation 

•  Sandy  Shrum,  Software  Engineering  Institute 

•  Nidhi  Srivastava,  Tata  Consultancy  Services 

•  Elizabeth  Sumpter,  NSA 

•  David  Swidorsky,  Bank  of  America 
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CMMI  VI. 3  Coordination  Team 

The  Coordination  team  brings  together  members  of  other  product 
development  teams  to  ensure  coordination  across  the  project. 

•  Rhonda  Brown,  Software  Engineering  Institute 

•  Mary  Beth  Chrissis,  Software  Engineering  Institute 

•  Eileen  Forrester,  Software  Engineering  Institute 

•  Will  Hayes,  Software  Engineering  Institute 

•  Mike  Konrad,  Software  Engineering  Institute 

•  So  Norimatsu,  Norimatsu  Process  Engineering  Lab,  Inc. 

•  Mary  Lynn  Penn,  Lockheed  Martin  Corporation 

•  David  (Mike)  Phillips,  Software  Engineering  Institute  (lead) 

•  Sandy  Shrum,  Software  Engineering  Institute 

•  Kathy  Smith,  Hewlett  Packard 

•  Barbara  Tyson,  Software  Engineering  Institute 

•  Rawdon  Young,  Software  Engineering  Institute 

•  Mary  Lynn  Russo,  Software  Engineering  Institute  (non-voting  member) 


CMMI  VI. 3  Configuration  Control  Board 

The  Configuration  Control  Board  approves  all  changes  to  CMMI  materials, 
including  the  models,  the  SCAMPI  MDD,  and  introductory  model  training. 

•  Rhonda  Brown,  Software  Engineering  Institute 

•  Michael  Campo,  Raytheon 

•  Mary  Beth  Chrissis,  Software  Engineering  Institute  (lead) 

•  Kirsten  Dauplaise,  NAVAIR 

•  Mike  Evanoo,  Systems  and  Software  Consortium,  Inc. 

•  Rich  Frost,  General  Motors 

•  Brian  Gallagher,  Northrop  Grumman 

•  Sally  Godfrey,  NASA 

•  Stephen  Gristock,  JP  Morgan  Chase  and  Co. 

•  Eric  Hayes  (non-voting  member) 

•  Nils  Jacobsen,  Motorola 

•  Steve  Kapurch,  NASA 

•  Mike  Konrad,  Software  Engineering  Institute 

•  Chris  Moore,  US  Air  Force 

•  Wendell  Mullison,  General  Dynamics  Land  Systems 

•  David  (Mike)  Phillips,  Software  Engineering  Institute 

•  Robert  Rassa,  Raytheon  Space  and  Airborne  Systems 

•  Karen  Richter,  Institute  for  Defense  Analyses 

•  Mary  Lou  Russo  (non-voting  member) 
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•  Warren  Schwoemeyer,  Lockheed  Martin  Corporation 

•  John  Scibilia,  US  Army 

•  Dave  Swidorsky,  Bank  of  America 

•  Barbara  Tyson,  Software  Engineering  Institute 

•  Mary  Van  Tyne,  Software  Engineering  Institute  (non-voting  member) 

•  Rawdon  Young,  Software  Engineering  Institute 


CMMI  VI .3  Core  Model  Team _ 

The  Core  Model  Team  develops  the  model  material  for  all  three 
constellations. 

•  Jim  Armstrong,  Stevens  Institute  of  Technology 

•  Rhonda  Brown,  Software  Engineering  Institute  (co-lead) 

•  Brandon  Buteau,  Northrop  Grumman 

•  Michael  Campo,  Raytheon 

•  Sandra  Cepeda,  Cepeda  Systems  &  Software  Analysis/RDECOM  SED 

•  Mary  Beth  Chrissis,  Software  Engineering  Institute 

•  Mike  D’Ambrosa,  Process  Performance  Professionals 

•  Eileen  Forrester,  Software  Engineering  Institute 

•  Will  Hayes,  Software  Engineering  Institute 

•  Mike  Konrad,  Software  Engineering  Institute  (co-lead) 

•  So  Norimatsu,  Norimatsu  Process  Engineering  Lab,  Inc. 

•  Mary  Lynn  Penn,  Lockheed  Martin  Corporation 

•  David  (Mike)  Phillips,  Software  Engineering  Institute 

•  Karen  Richter,  Institute  for  Defense  Analyses 

•  Mary  Lynn  Russo,  Software  Engineering  Institute  (non-voting  member) 

•  John  Scibilia,  US  Army 

•  Sandy  Shrum,  Software  Engineering  Institute  (co-lead) 

•  Kathy  Smith,  Hewlett  Packard 

•  Katie  Smith-McGarty,  US  Navy 


CMMI  VI. 3  Translation  Team 

The  Translation  Team  coordinates  translation  work  on  CMMI  materials. 

•  Richard  Basque,  Alcyonix 

•  Jose  Antonio  Calvo-Manzano,  Universidad  Politecnica  de  Madrid 

•  Carlos  Caram,  Integrated  Systems  Diagnostics  Brazil 

•  Gonzalo  Cuevas,  Universidad  Politecnica  de  Madrid 

•  Mike  Konrad,  Software  Engineering  Institute 

•  Antoine  Nardeze,  Alcyonix 


384 


CMMI  Version  1.3  Project  Participants 


CMMI  for  Acquisition,  Version  1.3 


•  So  Norimatsu,  Norimatsu  Process  Engineering  Lab,  Inc.  (lead) 

•  Seven  Ou,  Institute  for  Information  Industry 

•  Ricardo  Panero  Lamothe,  Accenture 

•  Mary  Lynn  Russo,  Software  Engineering  Institute  (non-voting  member) 

•  Winfried  Russwurm,  Siemens  AG 

•  Tomas  San  Feliu,  Universidad  Politecnica  de  Madrid 


CMMI  VI  .3  High  Maturity  Team _ 

The  High  Maturity  team  developed  high  maturity  model  material. 

•  Dan  Bennett,  US  Air  Force 

•  Will  Hayes,  Software  Engineering  Institute 

•  Rick  Hefner,  Northrop  Grumman 

•  Jim  Kubeck,  Lockheed  Martin  Corporation 

•  Alice  Parry,  Raytheon 

•  Mary  Lynn  Penn,  Lockheed  Martin  Corporation  (lead) 

•  Kathy  Smith,  Hewlett  Packard 

•  Rawdon  Young,  Software  Engineering  Institute 


CMMI  VI  .3  Acquisition  Mini  Team _ 

The  Acquisition  Mini  Team  provides  acquisition  expertise  for  model 
development  work. 

•  Rich  Frost,  General  Motors 

•  Tom  Keuten,  Keuten  and  Associates 

•  David  (Mike)  Phillips,  Software  Engineering  Institute  (lead) 

•  Karen  Richter,  Institute  for  Defense  Analyses 

•  John  Scibilia,  US  Army 


CMMI  VI .3  Services  Mini  Team _ 

The  Services  Mini  Team  provides  service  expertise  for  model  development 
work. 

•  Drew  Allison,  Systems  and  Software  Consortium,  Inc. 

•  Brandon  Buteau,  Northrop  Grumman 

•  Eileen  Forrester,  Software  Engineering  Institute  (lead) 

•  Christian  Hertneck,  Anywhere. 24  GmbH 

•  Pam  Schoppert,  Science  Applications  International  Corporation 
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CMMI  VI .3  SCAMPI  Upgrade  Team _ 

The  SCAMPI  Upgrade  team  develops  the  Appraisal  Requirements  for 
CMMI  (ARC)  document  and  SCAMPI  Method  Definition  Document  (MDD). 

•  Mary  Busby,  Lockheed  Martin  Corporation 

•  Palma  Buttles-Valdez,  Software  Engineering  Institute 

•  Paul  Byrnes,  Integrated  System  Diagnostics 

•  Will  Hayes,  Software  Engineering  Institute  (leader) 

•  Ravi  Khetan,  Northrop  Grumman 

•  Denise  Kirkham,  The  Boeing  Company 

•  Lisa  Ming,  The  Boeing  Company 

•  Charlie  Ryan,  Software  Engineering  Institute 

•  Kevin  Schaaff,  Software  Engineering  Institute 

•  Alexander  Stall,  Software  Engineering  Institute 

•  Agapi  Svolou,  Software  Engineering  Institute 

•  Ron  Ulrich,  Northrop  Grumman 


CMMI  Version  1.3  Training  Teams 

The  two  training  teams  (one  for  CMMI-DEV  and  CMMI-ACQ  and  the  other 
for  CMMI-SVC)  developed  model  training  materials. 

ACQ  and  DEV  Training  Team 

•  Barbara  Baldwin,  Software  Engineering  Institute 

•  Bonnie  Bollinger,  Process  Focus  Management 

•  Cat  Brandt-Zaccardi,  Software  Engineering  Institute 

•  Rhonda  Brown,  Software  Engineering  Institute 

•  Michael  Campo,  Raytheon 

•  Mary  Beth  Chrissis,  Software  Engineering  Institute  (lead) 

•  Stacey  Cope,  Software  Engineering  Institute 

•  Eric  Dorsett,  Jeppesen 

•  Dan  Foster,  PF  Williamson 

•  Eric  Hayes,  Software  Engineering  Institute 

•  Kurt  Hess,  Software  Engineering  Institute 

•  Mike  Konrad,  Software  Engineering  Institute 

•  Steve  Masters,  Software  Engineering  Institute 

•  Robert  McFeeley,  Software  Engineering  Institute 

•  Diane  Mizukami-Williams,  Northrop  Grumman 

•  Daniel  Pipitone,  Software  Engineering  Institute 

•  Mary  Lou  Russo,  Software  Engineering  Institute  (non-voting  member) 

•  Sandy  Shrum,  Software  Engineering  Institute 
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•  Katie  Smith-McGarty,  US  Navy 

•  Barbara  Tyson,  Software  Engineering  Institute 

SVC  Training  Team 

•  Drew  Allison,  Systems  and  Software  Consortium,  Inc. 

•  Mike  Bridges,  University  of  Pittsburgh  Medical  Center 

•  Paul  Byrnes,  Integrated  System  Diagnostics 

•  Sandra  Cepeda,  Cepeda  Systems  &  Software  Analysis/RDECOM  SED 

•  Eileen  Clark,  Tidewaters  Consulting 

•  Kieran  Doyle,  Excellence  in  Measurement 

•  Eileen  Forrester,  Software  Engineering  Institute  (lead  of  SVC  training) 

•  Suzanne  Miller,  Software  Engineering  Institute 

•  Hillel  Glazer,  Entinex 

•  Christian  Hertneck,  Anywhere. 24  GmbH 

•  Pat  Kirwan,  Software  Engineering  Institute 

•  Judah  Mogilensky,  PEP 

•  Heather  Oppenheimer,  Oppenheimer  Partners 

•  Pat  O’Toole,  PACT 

•  Agapi  Svolou,  Alexanna 

•  Jeff  Welch,  Software  Engineering  Institute 


CMMI  VI  .3  Quality  Team _ 

The  Quality  team  conducts  various  quality  assurance  checks  on  the  model 
material  to  ensure  its  accuracy,  readability,  and  consistency. 

•  Rhonda  Brown,  Software  Engineering  Institute  (co-lead) 

•  Erin  Harper,  Software  Engineering  Institute 

•  Mike  Konrad,  Software  Engineering  Institute 

•  Mary  Lou  Russo,  Software  Engineering  Institute 

•  Mary  Lynn  Russo,  Software  Engineering  Institute 

•  Sandy  Shrum,  Software  Engineering  Institute  (co-lead) 
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Appendix  D:  Glossary 


The  glossary  defines  the  basic  terms  used  in  CMMI  models.  Glossary 
entries  are  typically  multiple-word  terms  consisting  of  a  noun  and  one  or 
more  restrictive  modifiers.  (There  are  some  exceptions  to  this  rule  that 
account  for  one-word  terms  in  the  glossary.) 

The  CMMI  glossary  of  terms  is  not  a  required,  expected,  or  informative 
component  of  CMMI  models.  Interpret  the  terms  in  the  glossary  in  the 
context  of  the  model  component  in  which  they  appear. 

To  formulate  definitions  appropriate  for  CMMI,  we  consulted  multiple 
sources.  We  first  consulted  the  Merriam-Webster  OnLine  dictionary 
(http://www.merriam-webster.com/).  We  also  consulted  other  standards  as 
needed,  including  the  following: 

•  ISO  9000  [ISO  2005a] 

•  ISO/IEC  12207  [ISO  2008a] 

•  ISO/IEC  15504  [ISO  2006a] 

•  ISO/IEC  15288  [ISO  2008b] 

•  ISO/IEC  15939  [ISO  2007] 

•  ISO  20000-1  [ISO  2005b] 

•  IEEE  [IEEE  1991] 

•  CMM  for  Software  (SW-CMM)  vl  .1 

•  EIA  632  [EIA  2003] 

•  SA-CMM  [SEI  2002] 

•  People  CMM  (P-CMM)  [Curtis  2009] 

•  CobiT  v.  4.0  [IT  Governance  2005] 

•  ITIL  v3  (Service  Improvement,  Service  Design,  Service  Operation, 
Service  Strategy,  and  Service  Transition)  [Office  of  Government 
Commerce  2007] 

We  developed  the  glossary  recognizing  the  importance  of  using  terminology 
that  all  model  users  can  understand.  We  also  recognized  that  words  and 
terms  can  have  different  meanings  in  different  contexts  and  environments. 
The  glossary  in  CMMI  models  is  designed  to  document  the  meanings  of 
words  and  terms  that  should  have  the  widest  use  and  understanding  by 
users  of  CMMI  products. 

Even  though  the  term  “product”  includes  services  as  well  as  products  and 
the  term  “service”  is  defined  as  a  type  of  product,  many  of  the  terms  in  the 
glossary  contain  both  the  words  “product”  and  “service”  to  emphasize  that 
CMMI  applies  to  both  products  and  services. 
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acceptance  criteria 

acceptance  testing 

achievement  profile 

acquirer 
acquisition 
acquisition  strategy 

addition 

allocated 

requirement 


Every  glossary  entry  has  two  to  three  components.  There  is  always  a  term 
and  always  a  definition.  Sometimes  additional  notes  are  provided. 

The  term  defined  is  listed  on  the  left  side  of  the  page.  The  definition 
appears  first  in  a  type  size  similar  to  the  term  listed.  Glossary  notes  follow 
the  definition  and  are  in  a  smaller  type  size. 


The  criteria  that  a  deliverable  must  satisfy  to  be  accepted  by 
a  user,  customer,  or  other  authorized  entity.  (See  also 
“deliverable.”) 

Formal  testing  conducted  to  enable  a  user,  customer,  or 
other  authorized  entity  to  determine  whether  to  accept  a 
deliverable.  (See  also  “unit  testing.”) 

A  list  of  process  areas  and  their  corresponding  capability 
levels  that  represent  the  organization’s  progress  for  each 
process  area  while  advancing  through  the  capability  levels. 
(See  also  “capability  level  profile,”  “target  profile,”  and  “target 
staging.”) 

The  stakeholder  that  acquires  or  procures  a  product  or 
service  from  a  supplier.  (See  also  “stakeholder.”) 

The  process  of  obtaining  products  or  services  through 
supplier  agreements.  (See  also  “supplier  agreement.”) 

The  specific  approach  to  acquiring  products  and  services 
that  is  based  on  considerations  of  supply  sources, 
acquisition  methods,  requirements  specification  types, 
agreement  types,  and  related  acquisition  risks. 

A  clearly  marked  model  component  that  contains  information 
of  interest  to  particular  users. 

In  a  CMMI  model,  all  additions  bearing  the  same  name  can  be  optionally 
selected  as  a  group  for  use.  In  CMMI  for  Services,  the  Service  System 
Development  (SSD)  process  area  is  an  addition. 

Requirement  that  results  from  levying  all  or  part  of  a  higher 
level  requirement  on  a  lower  level  architectural  element  or 
design  component. 

More  generally,  requirements  can  be  allocated  to  other  logical  or  physical 
components  including  people,  consumables,  delivery  increments,  or  the 
architecture  as  a  whole,  depending  on  what  best  enables  the  product  or 
service  to  achieve  the  requirements. 
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An  examination  of  one  or  more  processes  by  a  trained  team 
of  professionals  using  an  appraisal  reference  model  as  the 
basis  for  determining,  at  a  minimum,  strengths  and 
weaknesses. 

This  term  has  a  special  meaning  in  the  CMMI  Product  Suite  besides  its 
common  standard  English  meaning. 

The  results  of  an  appraisal  that  identify  the  most  important 
issues,  problems,  or  opportunities  for  process  improvement 
within  the  appraisal  scope. 

Appraisal  findings  are  inferences  drawn  from  corroborated  objective 
evidence. 

Members  of  the  organizational  unit  who  participate  in 
providing  information  during  an  appraisal. 

The  value  assigned  by  an  appraisal  team  to  (a)  a  CMMI  goal 
or  process  area,  (b)  the  capability  level  of  a  process  area,  or 
(c)  the  maturity  level  of  an  organizational  unit. 

This  term  is  used  in  CMMI  appraisal  materials  such  as  the  SCAMPI  MDD. 
A  rating  is  determined  by  enacting  the  defined  rating  process  for  the 
appraisal  method  being  employed. 

The  CMMI  model  to  which  an  appraisal  team  correlates 
implemented  process  activities. 

This  term  is  used  in  CMMI  appraisal  materials  such  as  the  SCAMPI  MDD. 

The  definition  of  the  boundaries  of  an  appraisal 
encompassing  the  organizational  limits  and  CMMI  model 
limits  within  which  the  processes  to  be  investigated  operate. 

This  term  is  used  in  CMMI  appraisal  materials  such  as  the  SCAMPI  MDD. 

The  set  of  structures  needed  to  reason  about  a  product. 
These  structures  are  comprised  of  elements,  relations 
among  them,  and  properties  of  both. 

In  a  service  context,  the  architecture  is  often  applied  to  the  service 
system. 

Note  that  functionality  is  only  one  aspect  of  the  product.  Quality  attributes, 
such  as  responsiveness,  reliability,  and  security,  are  also  important  to 
reason  about.  Structures  provide  the  means  for  highlighting  different 
portions  of  the  architecture.  (See  also  “functional  architecture.”) 
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audit 


baseline 


base  measure 


bidirectional 

traceability 


An  objective  examination  of  a  work  product  or  set  of  work 
products  against  specific  criteria  (e.g.,  requirements).  (See 
also  “objectively  evaluate.”) 

This  is  a  term  used  in  several  ways  in  CMMI,  including  configuration 
audits  and  process  compliance  audits. 

A  set  of  specifications  or  work  products  that  has  been 
formally  reviewed  and  agreed  on,  which  thereafter  serves  as 
the  basis  for  further  development,  and  which  can  be 
changed  only  through  change  control  procedures.  (See  also 
“configuration  baseline”  and  “product  baseline.”) 

Measure  defined  in  terms  of  an  attribute  and  the  method  for 
quantifying  it.  (See  also  “derived  measure.”) 

A  base  measure  is  functionally  independent  of  other  measures. 

An  association  among  two  or  more  logical  entities  that  is 
discernable  in  either  direction  (i.e.,  to  and  from  an  entity). 
(See  also  “requirements  traceability”  and  “traceability.”) 


business  objectives 
capability  level 


capability  level 
profile 


capability  maturity 
model 


capable  process 


causal  analysis 


(See  “organization’s  business  objectives.”) 

Achievement  of  process  improvement  within  an  individual 
process  area.  (See  also  “generic  goal,”  “specific  goal,” 
“maturity  level,”  and  “process  area.”) 

A  capability  level  is  defined  by  appropriate  specific  and  generic  goals  for 
a  process  area. 

A  list  of  process  areas  and  their  corresponding  capability 
levels.  (See  also  “achievement  profile,”  “target  profile,”  and 
“target  staging.”) 

A  capability  level  profile  can  be  an  “achievement  profile”  when  it 
represents  the  organization’s  progress  for  each  process  area  while 
advancing  through  the  capability  levels.  Or,  it  can  be  a  “target  profile” 
when  it  represents  an  objective  for  process  improvement. 

A  model  that  contains  the  essential  elements  of  effective 
processes  for  one  or  more  areas  of  interest  and  describes 
an  evolutionary  improvement  path  from  ad  hoc,  immature 
processes  to  disciplined,  mature  processes  with  improved 
quality  and  effectiveness. 

A  process  that  can  satisfy  its  specified  product  quality, 
service  quality,  and  process  performance  objectives.  (See 
also  “stable  process”  and  “standard  process.”) 

The  analysis  of  outcomes  to  determine  their  causes. 
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configuration  audit 


configuration 

baseline 


Judicious  use  of  means  to  effect  a  change,  or  a  proposed 
change,  to  a  product  or  service.  (See  also  “configuration 
management.”) 

The  basic  structure  that  organizes  CMMI  components, 
including  elements  of  current  CMMI  models  as  well  as  rules 
and  methods  for  generating  models,  appraisal  methods 
(including  associated  artifacts),  and  training  materials.  (See 
also  “CMMI  model”  and  “CMMI  Product  Suite.”) 

The  framework  enables  new  areas  of  interest  to  be  added  to  CMMI  so 
that  they  will  integrate  with  the  existing  ones. 

A  model  generated  from  the  CMMI  Framework.  (See  also 
“CMMI  Framework”  and  “CMMI  Product  Suite.”) 

Any  of  the  main  architectural  elements  that  compose  a 
CMMI  model. 

Some  of  the  main  elements  of  a  CMMI  model  include  specific  practices, 
generic  practices,  specific  goals,  generic  goals,  process  areas,  capability 
levels,  and  maturity  levels. 

The  complete  set  of  products  developed  around  the  CMMI 
concept.  (See  also  “CMMI  Framework”  and  “CMMI  model.”) 

These  products  include  the  framework  itself,  models,  appraisal  methods, 
appraisal  materials,  and  training  materials. 

Items  that  can  be  purchased  from  a  commercial  supplier. 

The  variation  of  a  process  that  exists  because  of  normal  and 
expected  interactions  among  components  of  a  process. 

(See  also  “special  cause  of  variation.”) 

An  audit  conducted  to  verify  that  a  configuration  item  or  a 
collection  of  configuration  items  that  make  up  a  baseline 
conforms  to  a  specified  standard  or  requirement.  (See  also 
“audit”  and  “configuration  item.”) 

The  configuration  information  formally  designated  at  a 
specific  time  during  a  product’s  or  product  component’s  life. 
(See  also  “product  lifecycle.”) 

Configuration  baselines  plus  approved  changes  from  those  baselines 
constitute  the  current  configuration  information. 
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configuration 

control 


configuration 
control  board 


configuration 

identification 


configuration  item 


configuration 

management 


configuration  status 
accounting 


constellation 


An  element  of  configuration  management  consisting  of  the 
evaluation,  coordination,  approval  or  disapproval,  and 
implementation  of  changes  to  configuration  items  after 
formal  establishment  of  their  configuration  identification. 

(See  also  “configuration  identification,”  “configuration  item,” 
and  “configuration  management.”) 

A  group  of  people  responsible  for  evaluating  and  approving 
or  disapproving  proposed  changes  to  configuration  items 
and  for  ensuring  implementation  of  approved  changes.  (See 
also  “configuration  item.”) 

Configuration  control  boards  are  also  known  as  “change  control  boards.” 

An  element  of  configuration  management  consisting  of 
selecting  the  configuration  items  for  a  product,  assigning 
unique  identifiers  to  them,  and  recording  their  functional  and 
physical  characteristics  in  technical  documentation.  (See 
also  “configuration  item,”  “configuration  management,”  and 
“product.”) 

An  aggregation  of  work  products  that  is  designated  for 
configuration  management  and  treated  as  a  single  entity  in 
the  configuration  management  process.  (See  also 
“configuration  management.”) 

A  discipline  applying  technical  and  administrative  direction 
and  surveillance  to  (1 )  identify  and  document  the  functional 
and  physical  characteristics  of  a  configuration  item,  (2) 
control  changes  to  those  characteristics,  (3)  record  and 
report  change  processing  and  implementation  status,  and  (4) 
verify  compliance  with  specified  requirements.  (See  also 
“configuration  audit,”  “configuration  control,”  “configuration 
identification,”  and  “configuration  status  accounting.”) 

An  element  of  configuration  management  consisting  of  the 
recording  and  reporting  of  information  needed  to  manage  a 
configuration  effectively.  (See  also  “configuration 
identification”  and  “configuration  management.”) 

This  information  includes  a  list  of  the  approved  configuration,  the  status  of 
proposed  changes  to  the  configuration,  and  the  implementation  status  of 
approved  changes. 

A  collection  of  CMMI  components  that  are  used  to  construct 
models,  training  materials,  and  appraisal  related  documents 
for  an  area  of  interest  (e.g.,  acquisition,  development, 
services). 
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continuous 

representation 


contractor 

contractual 

requirements 


corrective  action 


A  capability  maturity  model  structure  wherein  capability 
levels  provide  a  recommended  order  for  approaching 
process  improvement  within  each  specified  process  area. 
(See  also  “capability  level,”  “process  area,”  and  “staged 
representation.”) 

(See  “supplier.”) 

The  result  of  the  analysis  and  refinement  of  customer 
requirements  into  a  set  of  requirements  suitable  to  be 
included  in  one  or  more  solicitation  packages,  or  supplier 
agreements.  (See  also  “acquirer,”  “customer  requirement,” 
“supplier  agreement,”  and  “solicitation  package.”) 

Contractual  requirements  include  both  technical  and  nontechnical 
requirements  necessary  for  the  acquisition  of  a  product  or  service. 

Acts  or  deeds  used  to  remedy  a  situation  or  remove  an 
error. 


customer 


customer 

requirement 


data 


The  party  responsible  for  accepting  the  product  or  for 
authorizing  payment. 

The  customer  is  external  to  the  project  or  work  group  (except  possibly  in 
certain  project  structures  in  which  the  customer  effectively  is  on  the 
project  team  or  in  the  work  group)  but  not  necessarily  external  to  the 
organization.  The  customer  can  be  a  higher  level  project  or  work  group. 
Customers  are  a  subset  of  stakeholders.  (See  also  “stakeholder.”) 

In  most  cases  where  this  term  is  used,  the  preceding  definition  is 
intended;  however,  in  some  contexts,  the  term  “customer”  is  intended  to 
include  other  relevant  stakeholders.  (See  also  “customer  requirement.”) 

End  users  can  be  distinguished  from  customers  if  the  parties  that  directly 
receive  the  value  of  products  and  services  are  not  the  same  as  the 
parties  that  arrange  for,  pay  for,  or  negotiate  agreements.  In  contexts 
where  customers  and  end  users  are  essentially  the  same  parties,  the 
term  “customer”  can  encompass  both  types.  (See  also  “end  user.”) 

The  result  of  eliciting,  consolidating,  and  resolving  conflicts 
among  the  needs,  expectations,  constraints,  and  interfaces 
of  the  product’s  relevant  stakeholders  in  a  way  that  is 
acceptable  to  the  customer.  (See  also  “customer.”) 

Recorded  information. 

Recorded  information  can  include  technical  data,  computer  software 
documents,  financial  information,  management  information, 
representation  of  facts,  numbers,  or  datum  of  any  nature  that  can  be 
communicated,  stored,  and  processed. 
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data  management 


defect  density 


defined  process 


definition  of 
required 

functionality  and 
quality  attributes 


deliverable 


The  disciplined  processes  and  systems  that  plan  for, 
acquire,  and  provide  stewardship  for  business  and  technical 
data,  consistent  with  data  requirements,  throughout  the  data 
lifecycle. 

Number  of  defects  per  unit  of  product  size. 

An  example  is  the  number  of  problem  reports  per  thousand  lines  of  code. 

A  managed  process  that  is  tailored  from  the  organization’s 
set  of  standard  processes  according  to  the  organization’s 
tailoring  guidelines;  has  a  maintained  process  description; 
and  contributes  process  related  experiences  to  the 
organizational  process  assets.  (See  also  “managed 
process.”) 

A  characterization  of  required  functionality  and  quality 
attributes  obtained  through  “chunking,”  organizing, 
annotating,  structuring,  or  formalizing  the  requirements 
(functional  and  non-functional)  to  facilitate  further  refinement 
and  reasoning  about  the  requirements  as  well  as  (possibly, 
initial)  solution  exploration,  definition,  and  evaluation.  (See 
also  “architecture,”  “functional  architecture,”  and  “quality 
attribute.”) 

As  technical  solution  processes  progress,  this  characterization  can  be 
further  evolved  into  a  description  of  the  architecture  versus  simply  helping 
scope  and  guide  its  development,  depending  on  the  engineering 
processes  used;  requirements  specification  and  architectural  languages 
used;  and  the  tools  and  the  environment  used  for  product  or  service 
system  development. 

An  item  to  be  provided  to  an  acquirer  or  other  designated 
recipient  as  specified  in  an  agreement.  (See  also  “acquirer.”) 

This  item  can  be  a  document,  hardware  item,  software  item,  service,  or 
any  type  of  work  product. 
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delivery 

environment 


derived  measure 


derived 

requirements 


design  review 


development 


document 


The  complete  set  of  circumstances  and  conditions  under 
which  services  are  delivered  in  accordance  with  service 
agreements.  (See  also  “service”  and  “service  agreement.”) 

The  delivery  environment  encompasses  everything  that  has  or  can  have  a 
significant  effect  on  service  delivery,  including  but  not  limited  to  service 
system  operation,  natural  phenomena,  and  the  behavior  of  all  parties, 
whether  or  not  they  intend  to  have  such  an  effect.  For  example,  consider 
the  effect  of  weather  or  traffic  patterns  on  a  transportation  service.  (See 
also  “service  system.”) 

The  delivery  environment  is  uniquely  distinguished  from  other 
environments  (e.g.,  simulation  environments,  testing  environments).  The 
delivery  environment  is  the  one  in  which  services  are  actually  delivered 
and  count  as  satisfying  a  service  agreement. 

Measure  that  is  defined  as  a  function  of  two  or  more  values 
of  base  measures.  (See  also  “base  measure.”) 

Requirements  that  are  not  explicitly  stated  in  customer 
requirements  but  are  inferred  (1)  from  contextual 
requirements  (e.g.,  applicable  standards,  laws,  policies, 
common  practices,  management  decisions)  or  (2)  from 
requirements  needed  to  specify  a  product  or  service 
component. 

Derived  requirements  can  also  arise  during  analysis  and  design  of 
components  of  the  product  or  service.  (See  also  “product  requirements.”) 

A  formal,  documented,  comprehensive,  and  systematic 
examination  of  a  design  to  determine  if  the  design  meets  the 
applicable  requirements,  to  identify  problems,  and  to 
propose  solutions. 

To  create  a  product  or  service  system  by  deliberate  effort. 

In  some  contexts,  development  can  include  the  maintenance  of  the 
developed  product. 

A  collection  of  data,  regardless  of  the  medium  on  which  it  is 
recorded,  that  generally  has  permanence  and  can  be  read 
by  humans  or  machines. 

Documents  include  both  paper  and  electronic  documents. 
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establish  and 
maintain 
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A  party  that  ultimately  uses  a  delivered  product  or  that 
receives  the  benefit  of  a  delivered  service.  (See  also 
“customer.”) 

End  users  may  or  may  not  also  be  customers  (who  can  establish  and 
accept  agreements  or  authorize  payments). 

In  contexts  where  a  single  service  agreement  covers  multiple  service 
deliveries,  any  party  that  initiates  a  service  request  can  be  considered  an 
end  user.  (See  also  “service  agreement”  and  “service  request.”) 

The  full  composition  of  a  company.  (See  also 
“organization.”) 

A  company  can  consist  of  many  organizations  in  many  locations  with 
different  customers. 

States  of  being  that  must  be  present  before  an  effort  can 
begin  successfully. 

A  target  staging,  created  using  the  continuous 
representation  that  is  defined  so  that  the  results  of  using  the 
target  staging  can  be  compared  to  maturity  levels  of  the 
staged  representation.  (See  also  “capability  level  profile,” 
“maturity  level,”  “target  profile,”  and  “target  staging.”) 

Such  staging  permits  benchmarking  of  progress  among  organizations, 
enterprises,  projects,  and  work  groups,  regardless  of  the  CMMI 
representation  used.  The  organization  can  implement  components  of 
CMMI  models  beyond  the  ones  reported  as  part  of  equivalent  staging. 
Equivalent  staging  relates  how  the  organization  compares  to  other 
organizations  in  terms  of  maturity  levels. 

Create,  document,  use,  and  revise  work  products  as 
necessary  to  ensure  they  remain  useful. 

The  phrase  “establish  and  maintain”  plays  a  special  role  in 
communicating  a  deeper  principle  in  CMMI:  work  products  that  have  a 
central  or  key  role  in  work  group,  project,  and  organizational  performance 
should  be  given  attention  to  ensure  they  are  used  and  useful  in  that  role. 

This  phrase  has  particular  significance  in  CMMI  because  it  often  appears 
in  goal  and  practice  statements  (though  in  the  former  as  "established  and 
maintained")  and  should  be  taken  as  shorthand  for  applying  the  principle 
to  whatever  work  product  is  the  object  of  the  phrase. 

An  informative  model  component  that  provides  sample 
outputs  from  a  specific  practice. 

(See  “senior  manager.”) 
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expected  CMMI 
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findings 

formal  evaluation 
process 

framework 
functional  analysis 


functional 

architecture 

generic  goal 

generic  practice 


generic  practice 
elaboration 


States  of  being  that  must  be  present  before  an  effort  can  end 
successfully. 

CMMI  components  that  describe  the  activities  that  are 
important  in  achieving  a  required  CMMI  component. 

Model  users  can  implement  the  expected  components  explicitly  or 
implement  equivalent  practices  to  these  components.  Specific  and 
generic  practices  are  expected  model  components. 

(See  “appraisal  findings.”) 

A  structured  approach  to  evaluating  alternative  solutions 
against  established  criteria  to  determine  a  recommended 
solution  to  address  an  issue. 

(See  “CMMI  Framework.”) 

Examination  of  a  defined  function  to  identify  all  the 
subfunctions  necessary  to  accomplish  that  function; 
identification  of  functional  relationships  and  interfaces 
(internal  and  external)  and  capturing  these  relationships  and 
interfaces  in  a  functional  architecture;  and  flow  down  of 
upper  level  requirements  and  assignment  of  these 
requirements  to  lower  level  subfunctions.  (See  also 
“functional  architecture.”) 

The  hierarchical  arrangement  of  functions,  their  internal  and 
external  (external  to  the  aggregation  itself)  functional 
interfaces  and  external  physical  interfaces,  their  respective 
requirements,  and  their  design  constraints.  (See  also 
“architecture,”  “functional  analysis,”  and  “definition  of 
required  functionality  and  quality  attributes.”) 

A  required  model  component  that  describes  characteristics 
that  must  be  present  to  institutionalize  processes  that 
implement  a  process  area.  (See  also  “institutionalization.”) 

An  expected  model  component  that  is  considered  important 
in  achieving  the  associated  generic  goal. 

The  generic  practices  associated  with  a  generic  goal  describe  the 
activities  that  are  expected  to  result  in  achievement  of  the  generic  goal 
and  contribute  to  the  institutionalization  of  the  processes  associated  with 
a  process  area. 

An  informative  model  component  that  appears  after  a 
generic  practice  to  provide  guidance  on  how  the  generic 
practice  could  be  applied  uniquely  to  a  process  area.  (This 
model  component  is  not  present  in  all  CMMI  models.) 
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interface  control 


lifecycle  model 


The  application  of  a  systematic,  disciplined,  and  quantifiable 
approach  to  transforming  a  set  of  requirements  that 
represent  the  collection  of  stakeholder  needs,  expectations, 
and  constraints,  using  documented  techniques  and 
technology  to  design,  implement,  and  maintain  a  tangible 
product.  (See  also  “software  engineering”  and  “systems 
engineering.”) 

In  CMMI,  hardware  engineering  represents  all  technical  fields  (e.g., 
electrical,  mechanical)  that  transform  requirements  and  ideas  into 
tangible  products. 

The  person  or  persons  who  provide  the  policy  and  overall 
guidance  for  the  process  but  do  not  provide  the  direct  day- 
to-day  monitoring  and  controlling  of  the  process.  (See  also 
“senior  manager.”) 

Such  persons  belong  to  a  level  of  management  in  the  organization  above 
the  immediate  level  responsible  for  the  process  and  can  be  (but  are  not 
necessarily)  senior  managers. 

A  process  that  is  not  performed  or  is  performed  only 
partially;  one  or  more  of  the  specific  goals  of  the  process 
area  are  not  satisfied. 

An  incomplete  process  is  also  known  as  capability  level  0. 

CMMI  components  that  help  model  users  understand  the 
required  and  expected  components  of  a  model. 

These  components  can  be  examples,  detailed  explanations,  or  other 
helpful  information.  Subpractices,  notes,  references,  goal  titles,  practice 
titles,  sources,  example  work  products,  and  generic  practice  elaborations 
are  informative  model  components. 

The  ingrained  way  of  doing  business  that  an  organization 
follows  routinely  as  part  of  its  corporate  culture. 

In  configuration  management,  the  process  of  (1)  identifying 
all  functional  and  physical  characteristics  relevant  to  the 
interfacing  of  two  or  more  configuration  items  provided  by 
one  or  more  organizations  and  (2)  ensuring  that  proposed 
changes  to  these  characteristics  are  evaluated  and 
approved  prior  to  implementation.  (See  also  “configuration 
item”  and  “configuration  management.”) 

A  partitioning  of  the  life  of  a  product,  service,  project,  work 
group,  or  set  of  work  activities  into  phases. 
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managed  process 

manager 

maturity  level 

measure  (noun) 

measurement 

measurement  result 

memorandum  of 
agreement 

natural  bounds 


A  performed  process  that  is  planned  and  executed  in 
accordance  with  policy;  employs  skilled  people  having 
adequate  resources  to  produce  controlled  outputs;  involves 
relevant  stakeholders;  is  monitored,  controlled,  and 
reviewed;  and  is  evaluated  for  adherence  to  its  process 
description.  (See  also  “performed  process.”) 

A  person  who  provides  technical  and  administrative 
direction  and  control  to  those  who  perform  tasks  or  activities 
within  the  manager’s  area  of  responsibility. 

This  term  has  a  special  meaning  in  the  CMMI  Product  Suite  besides  its 
common  standard  English  meaning.  The  traditional  functions  of  a 
manager  include  planning,  organizing,  directing,  and  controlling  work 
within  an  area  of  responsibility. 

Degree  of  process  improvement  across  a  predefined  set  of 
process  areas  in  which  all  goals  in  the  set  are  attained.  (See 
also  “capability  level”  and  “process  area.”) 

Variable  to  which  a  value  is  assigned  as  a  result  of 
measurement.  (See  also  “base  measure,”  “derived 
measure,”  and  “measurement.”) 

The  definition  of  this  term  in  CMMI  is  consistent  with  the  definition  of  this 
term  in  ISO  15939. 

A  set  of  operations  to  determine  the  value  of  a  measure. 
(See  also  “measure.”) 

The  definition  of  this  term  in  CMMI  is  consistent  with  the  definition  of  this 
term  in  ISO  15939. 

A  value  determined  by  performing  a  measurement.  (See 
also  “measurement.”) 

Binding  document  of  understanding  or  agreement  between 
two  or  more  parties. 

A  memorandum  of  agreement  is  also  known  as  a  “memorandum  of 
understanding.” 

The  inherent  range  of  variation  in  a  process,  as  determined 
by  process  performance  measures. 

Natural  bounds  are  sometimes  referred  to  as  “voice  of  the  process.” 

Techniques  such  as  control  charts,  confidence  intervals,  and  prediction 
intervals  are  used  to  determine  whether  the  variation  is  due  to  common 
causes  (i.e.,  the  process  is  predictable  or  stable)  or  is  due  to  some 
special  cause  that  can  and  should  be  identified  and  removed.  (See  also 
“measure”  and  “process  performance.”) 


Glossary 


401 


CMMI  for  Acquisition,  Version  1.3 


nondevelopmental 

item 


nontechnical 

requirements 


objectively  evaluate 


operational  concept 


operational  scenario 


organization 


organizational 

maturity 


An  item  that  was  developed  prior  to  its  current  use  in  an 
acquisition  or  development  process. 

Such  an  item  can  require  minor  modifications  to  meet  the  requirements  of 
its  current  intended  use. 

Requirements  affecting  product  and  service  acquisition  or 
development  that  are  not  properties  of  the  product  or 
service. 

Examples  include  numbers  of  products  or  services  to  be  delivered,  data 
rights  for  delivered  COTS  and  nondevelopmental  items,  delivery  dates, 
and  milestones  with  exit  criteria.  Other  nontechnical  requirements  include 
work  constraints  associated  with  training,  site  provisions,  and  deployment 
schedules. 

To  review  activities  and  work  products  against  criteria  that 
minimize  subjectivity  and  bias  by  the  reviewer.  (See  also 
“audit.”) 

An  example  of  an  objective  evaluation  is  an  audit  against  requirements, 
standards,  or  procedures  by  an  independent  quality  assurance  function. 

A  general  description  of  the  way  in  which  an  entity  is  used  or 
operates. 

An  operational  concept  is  also  known  as  “concept  of  operations.” 

A  description  of  an  imagined  sequence  of  events  that 
includes  the  interaction  of  the  product  or  service  with  its 
environment  and  users,  as  well  as  interaction  among  its 
product  or  service  components. 

Operational  scenarios  are  used  to  evaluate  the  requirements  and  design 
of  the  system  and  to  verify  and  validate  the  system. 

An  administrative  structure  in  which  people  collectively 
manage  one  or  more  projects  or  work  groups  as  a  whole, 
share  a  senior  manager,  and  operate  under  the  same 
policies. 

However,  the  word  “organization”  as  used  throughout  CMMI  models  can 
also  apply  to  one  person  who  performs  a  function  in  a  small  organization 
that  might  be  performed  by  a  group  of  people  in  a  large  organization. 

(See  also  “enterprise.”) 

The  extent  to  which  an  organization  has  explicitly  and 
consistently  deployed  processes  that  are  documented, 
managed,  measured,  controlled,  and  continually  improved. 

Organizational  maturity  can  be  measured  via  appraisals. 
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organizational 

policy 


organizational 
process  assets 


organization’s 
business  objectives 


organization’s 

measurement 

repository 


organization’s 
process  asset 
library 


organization’s  set  of 
standard  processes 


A  guiding  principle  typically  established  by  senior 
management  that  is  adopted  by  an  organization  to  influence 
and  determine  decisions. 

Artifacts  that  relate  to  describing,  implementing,  and 
improving  processes. 

Examples  of  these  artifacts  include  policies,  measurement  descriptions, 
process  descriptions,  process  implementation  support  tools. 

The  term  “process  assets”  is  used  to  indicate  that  these  artifacts  are 
developed  or  acquired  to  meet  the  business  objectives  of  the  organization 
and  that  they  represent  investments  by  the  organization  that  are  expected 
to  provide  current  and  future  business  value.  (See  also  “process  asset 
library.”) 

Senior-management-developed  objectives  designed  to 
ensure  an  organization’s  continued  existence  and  enhance 
its  profitability,  market  share,  and  other  factors  influencing 
the  organization’s  success.  (See  also  “quality  and  process 
performance  objectives”  and  “quantitative  objective.”) 


A  repository  used  to  collect  and  make  measurement  results 
available  on  processes  and  work  products,  particularly  as 
they  relate  to  the  organization’s  set  of  standard  processes. 

This  repository  contains  or  references  actual  measurement  results  and 
related  information  needed  to  understand  and  analyze  measurement 
results. 

A  library  of  information  used  to  store  and  make  process 
assets  available  that  are  useful  to  those  who  are  defining, 
implementing,  and  managing  processes  in  the  organization. 

This  library  contains  process  assets  that  include  process  related 
documentation  such  as  policies,  defined  processes,  checklists,  lessons 
learned  documents,  templates,  standards,  procedures,  plans,  and  training 
materials. 

A  collection  of  definitions  of  the  processes  that  guide 
activities  in  an  organization. 

These  process  descriptions  cover  the  fundamental  process  elements 
(and  their  relationships  to  each  other  such  as  ordering  and  interfaces) 
that  should  be  incorporated  into  the  defined  processes  that  are 
implemented  in  projects,  work  groups,  and  work  across  the  organization. 
A  standard  process  enables  consistent  development  and  maintenance 
activities  across  the  organization  and  is  essential  for  long-term  stability 
and  improvement.  (See  also  “defined  process”  and  “process  element.”) 
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outsourcing 
peer  review 

performance 

parameters 

performed  process 

planned  process 

policy 

process 


process  action  plan 

process  action  team 


(See  “acquisition.”) 

The  review  of  work  products  performed  by  peers  during  the 
development  of  work  products  to  identify  defects  for 
removal.  (See  also  “work  product.”) 

The  term  “peer  review”  is  used  in  the  CMMI  Product  Suite  instead  of  the 
term  “work  product  inspection.” 

The  measures  of  effectiveness  and  other  key  measures 
used  to  guide  and  control  progressive  development. 

A  process  that  accomplishes  the  needed  work  to  produce 
work  products;  the  specific  goals  of  the  process  area  are 
satisfied. 

A  process  that  is  documented  by  both  a  description  and  a 
plan. 

The  description  and  plan  should  be  coordinated  and  the  plan  should 
include  standards,  requirements,  objectives,  resources,  and  assignments. 

(See  “organizational  policy.”) 

A  set  of  interrelated  activities,  which  transform  inputs  into 
outputs,  to  achieve  a  given  purpose.  (See  also  “process 
area,”  “subprocess,”  and  “process  element.”) 

There  is  a  special  use  of  the  phrase  “the  process”  in  the  statements  and 
descriptions  of  the  generic  goals  and  generic  practices.  “The  process,”  as 
used  in  Part  Two,  is  the  process  or  processes  that  implement  the  process 
area. 

The  terms  “process,”  “subprocess”  and  “process  element”  form  a 
hierarchy  with  “process”  as  the  highest,  most  general  term, 
“subprocesses”  below  it,  and  “process  element”  as  the  most  specific.  A 
particular  process  can  be  called  a  subprocess  if  it  is  part  of  another  larger 
process.  It  can  also  be  called  a  process  element  if  it  is  not  decomposed 
into  subprocesses. 

This  definition  of  process  is  consistent  with  the  definition  of  process  in 
ISO  9000,  ISO  12207,  ISO  15504,  and  EIA  731. 

A  plan,  usually  resulting  from  appraisals,  that  documents 
how  specific  improvements  targeting  the  weaknesses 
uncovered  by  an  appraisal  will  be  implemented. 

A  team  that  has  the  responsibility  to  develop  and  implement 
process  improvement  activities  for  an  organization  as 
documented  in  a  process  action  plan. 
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process  and 

technology 

improvements 

process  architecture 


process  area 


process  asset 

process  asset 
library 

process  attribute 
process  capability 
process  definition 

process  description 


Incremental  and  innovative  improvements  to  processes  and 
to  process,  product,  or  service  technologies. 

(1)  The  ordering,  interfaces,  interdependencies,  and  other 
relationships  among  the  process  elements  in  a  standard 
process,  or  (2)  the  interfaces,  interdependencies,  and  other 
relationships  between  process  elements  and  external 
processes. 

A  cluster  of  related  practices  in  an  area  that,  when 
implemented  collectively,  satisfies  a  set  of  goals  considered 
important  for  making  improvement  in  that  area. 

Anything  the  organization  considers  useful  in  attaining  the 
goals  of  a  process  area.  (See  also  “organizational  process 
assets.”) 

A  collection  of  process  asset  holdings  that  can  be  used  by 
an  organization,  project,  or  workgroup.  (See  also 
“organization’s  process  asset  library.”) 

A  measurable  characteristic  of  process  capability  applicable 
to  any  process. 

The  range  of  expected  results  that  can  be  achieved  by 
following  a  process. 

The  act  of  defining  and  describing  a  process. 

The  result  of  process  definition  is  a  process  description.  (See  also 
“process  description.”) 

A  documented  expression  of  a  set  of  activities  performed  to 
achieve  a  given  purpose. 

A  process  description  provides  an  operational  definition  of  the  major 
components  of  a  process.  The  description  specifies,  in  a  complete, 
precise,  and  verifiable  manner,  the  requirements,  design,  behavior,  or 
other  characteristics  of  a  process.  It  also  can  include  procedures  for 
determining  whether  these  provisions  have  been  satisfied.  Process 
descriptions  can  be  found  at  the  activity,  project,  work  group,  or 
organizational  level. 
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process  element 


process  group 


process 

improvement 


process 

improvement 

objectives 


process 

improvement  plan 


process 

measurement 


The  fundamental  unit  of  a  process. 

A  process  can  be  defined  in  terms  of  subprocesses  or  process  elements. 
A  subprocess  is  a  process  element  when  it  is  not  further  decomposed  into 
subprocesses  or  process  elements.  (See  also  “process”  and 
“subprocess.”) 

Each  process  element  covers  a  closely  related  set  of  activities  (e.g., 
estimating  element,  peer  review  element).  Process  elements  can  be 
portrayed  using  templates  to  be  completed,  abstractions  to  be  refined,  or 
descriptions  to  be  modified  or  used.  A  process  element  can  be  an  activity 
or  task. 

The  terms  “process,”  “subprocess,”  and  “process  element”  form  a 
hierarchy  with  “process”  as  the  highest,  most  general  term, 
“subprocesses”  below  it,  and  “process  element”  as  the  most  specific. 

A  collection  of  specialists  who  facilitate  the  definition, 
maintenance,  and  improvement  of  processes  used  by  the 
organization. 

A  program  of  activities  designed  to  improve  the  process 
performance  and  maturity  of  the  organization’s  processes, 
and  the  results  of  such  a  program. 

A  set  of  target  characteristics  established  to  guide  the  effort 
to  improve  an  existing  process  in  a  specific,  measurable 
way  either  in  terms  of  resultant  product  or  service 
characteristics  (e.g.,  quality,  product  performance, 
conformance  to  standards)  or  in  the  way  in  which  the 
process  is  executed  (e.g.,  elimination  of  redundant  process 
steps,  combination  of  process  steps,  improvement  of  cycle 
time).  (See  also  “organization’s  business  objectives”  and 
“quantitative  objective.”) 

A  plan  for  achieving  organizational  process  improvement 
objectives  based  on  a  thorough  understanding  of  current 
strengths  and  weaknesses  of  the  organization’s  processes 
and  process  assets. 

A  set  of  operations  used  to  determine  values  of  measures  of 
a  process  and  its  resulting  products  or  services  for  the 
purpose  of  characterizing  and  understanding  the  process. 
(See  also  “measurement.”) 
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process  owner 


process 

performance 


process 

performance 

baseline 


process 

performance  model 


process  tailoring 


The  person  (or  team)  responsible  for  defining  and 
maintaining  a  process. 

At  the  organizational  level,  the  process  owner  is  the  person  (or  team) 
responsible  for  the  description  of  a  standard  process;  at  the  project  or 
work  group  level,  the  process  owner  is  the  person  (or  team)  responsible 
for  the  description  of  the  defined  process.  A  process  can  therefore  have 
multiple  owners  at  different  levels  of  responsibility.  (See  also  “defined 
process”  and  “standard  process.”) 

A  measure  of  results  achieved  by  following  a  process.  (See 
also  “measure.”) 

Process  performance  is  characterized  by  both  process  measures  (e.g., 
effort,  cycle  time,  defect  removal  efficiency)  and  product  or  service 
measures  (e.g.,  reliability,  defect  density,  response  time). 

A  documented  characterization  of  process  performance, 
which  can  include  central  tendency  and  variation.  (See  also 
“process  performance.”) 

A  process  performance  baseline  can  be  used  as  a  benchmark  for 
comparing  actual  process  performance  against  expected  process 
performance. 

A  description  of  relationships  among  the  measurable 
attributes  of  one  or  more  processes  or  work  products  that  is 
developed  from  historical  process  performance  data  and  is 
used  to  predict  future  performance.  (See  also  “measure.”) 

One  or  more  of  the  measureable  attributes  represent  controllable  inputs 
tied  to  a  subprocess  to  enable  performance  of  “what-if  analyses  for 
planning,  dynamic  re-planning,  and  problem  resolution.  Process 
performance  models  include  statistical,  probabilistic  and  simulation  based 
models  that  predict  interim  or  final  results  by  connecting  past 
performance  with  future  outcomes.  They  model  the  variation  of  the 
factors,  and  provide  insight  into  the  expected  range  and  variation  of 
predicted  results.  A  process  performance  model  can  be  a  collection  of 
models  that  (when  combined)  meet  the  criteria  of  a  process  performance 
model. 

Making,  altering,  or  adapting  a  process  description  for  a 
particular  end. 

For  example,  a  project  or  work  group  tailors  its  defined  process  from  the 
organization’s  set  of  standard  processes  to  meet  objectives,  constraints, 
and  the  environment  of  the  project  or  work  group.  (See  also  “defined 
process,”  “organization’s  set  of  standard  processes,”  and  “process 
description.”) 
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product 

product  baseline 

product  component 


product  component 
requirements 

product  lifecycle 


A  work  product  that  is  intended  for  delivery  to  a  customer  or 
end  user. 

This  term  has  a  special  meaning  in  the  CMMI  Product  Suite  besides  its 
common  standard  English  meaning.  The  form  of  a  product  can  vary  in 
different  contexts.  (See  also  “customer,”  “product  component,”  “service,” 
and  “work  product.”) 

The  initial  approved  technical  data  package  defining  a 
configuration  item  during  the  production,  operation, 
maintenance,  and  logistic  support  of  its  lifecycle.  (See  also 
“configuration  item,”  “configuration  management,”  and 
“technical  data  package.”) 

This  term  is  related  to  configuration  management. 

A  work  product  that  is  a  lower  level  component  of  the 
product.  (See  also  “product”  and  “work  product.”) 

Product  components  are  integrated  to  produce  the  product.  There  can  be 
multiple  levels  of  product  components. 

Throughout  the  process  areas,  where  the  terms  “product”  and  “product 
component”  are  used,  their  intended  meanings  also  encompass  services, 
service  systems,  and  their  components. 

This  term  has  a  special  meaning  in  the  CMMI  Product  Suite  besides  its 
common  standard  English  meaning. 

A  complete  specification  of  a  product  or  service  component, 
including  fit,  form,  function,  performance,  and  any  other 
requirement. 

The  period  of  time,  consisting  of  phases,  that  begins  when  a 
product  or  service  is  conceived  and  ends  when  the  product 
or  service  is  no  longer  available  for  use. 

Since  an  organization  can  be  producing  multiple  products  or  services  for 
multiple  customers,  one  description  of  a  product  lifecycle  may  not  be 
adequate.  Therefore,  the  organization  can  define  a  set  of  approved 
product  lifecycle  models.  These  models  are  typically  found  in  published 
literature  and  are  likely  to  be  tailored  for  use  in  an  organization. 

A  product  lifecycle  could  consist  of  the  following  phases:  (1 )  concept  and 
vision,  (2)  feasibility,  (3)  design/development,  (4)  production,  and  (5) 
phase  out. 
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product  line 


product  related 
lifecycle  processes 


product 

requirements 


product  suite 
project 


A  group  of  products  sharing  a  common,  managed  set  of 
features  that  satisfy  specific  needs  of  a  selected  market  or 
mission  and  that  are  developed  from  a  common  set  of  core 
assets  in  a  prescribed  way.  (See  also  “service  line.”) 

The  development  or  acquisition  of  products  for  the  product  line  is  based 
on  exploiting  commonality  and  bounding  variation  (i.e.,  restricting 
unnecessary  product  variation)  across  the  group  of  products.  The 
managed  set  of  core  assets  (e.g.,  requirements,  architectures, 
components,  tools,  testing  artifacts,  operating  procedures,  software) 
includes  prescriptive  guidance  for  their  use  in  product  development. 
Product  line  operations  involve  interlocking  execution  of  the  broad 
activities  of  core  asset  development,  product  development,  and 
management. 

Many  people  use  “product  line”  just  to  mean  the  set  of  products  produced 
by  a  particular  business  unit,  whether  they  are  built  with  shared  assets  or 
not.  We  call  that  collection  a  "portfolio,"  and  reserve  "product  line"  to  have 
the  technical  meaning  given  here. 

Processes  associated  with  a  product  or  service  throughout 
one  or  more  phases  of  its  life  (e.g.,  from  conception  through 
disposal),  such  as  manufacturing  and  support  processes. 

A  refinement  of  customer  requirements  into  the  developers’ 
language,  making  implicit  requirements  into  explicit  derived 
requirements.  (See  also  “derived  requirements”  and 
“product  component  requirements.”) 

The  developer  uses  product  requirements  to  guide  the  design  and 
building  of  the  product  or  service. 

(See  “CMMI  Product  Suite.”) 

A  managed  set  of  interrelated  activities  and  resources, 
including  people,  that  delivers  one  or  more  products  or 
services  to  a  customer  or  end  user. 

A  project  has  an  intended  beginning  (i.e.,  project  startup)  and  end. 
Projects  typically  operate  according  to  a  plan.  Such  a  plan  is  frequently 
documented  and  specifies  what  is  to  be  delivered  or  implemented,  the 
resources  and  funds  to  be  used,  the  work  to  be  done,  and  a  schedule  for 
doing  the  work.  A  project  can  be  composed  of  projects.  (See  also  “project 
startup.”) 

In  some  contexts,  the  term  “program”  is  used  to  refer  to  a  project. 
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project  plan 

project  progress 
and  performance 

project  startup 

prototype 


quality 

quality  and  process 

performance 

objectives 


A  plan  that  provides  the  basis  for  performing  and  controlling 
the  project’s  activities,  which  addresses  the  commitments  to 
the  project’s  customer. 

Project  planning  includes  estimating  the  attributes  of  work  products  and 
tasks,  determining  the  resources  needed,  negotiating  commitments, 
producing  a  schedule,  and  identifying  and  analyzing  project  risks. 

Iterating  through  these  activities  may  be  necessary  to  establish  the 
project  plan. 

What  a  project  achieves  with  respect  to  implementing 
project  plans,  including  effort,  cost,  schedule,  and  technical 
performance.  (See  also  “technical  performance.”) 

When  a  set  of  interrelated  resources  for  a  project  are 
directed  to  develop  or  deliver  one  or  more  products  or 
services  for  a  customer  or  end  user.  (See  also  “project.”) 

A  preliminary  type,  form,  or  instance  of  a  product,  service, 
product  component,  or  service  component  that  serves  as  a 
model  for  later  stages  or  for  the  final,  complete  version  of 
the  product  or  service. 

This  model  of  the  product  or  service  (e.g.,  physical,  electronic,  digital, 
analytical)  can  be  used  for  the  following  (and  other)  purposes: 

•  Assessing  the  feasibility  of  a  new  or  unfamiliar  technology 

•  Assessing  or  mitigating  technical  risk 

•  Validating  requirements 

•  Demonstrating  critical  features 

•  Qualifying  a  product  or  service 

•  Qualifying  a  process 

•  Characterizing  performance  or  features  of  the  product  or  service 

•  Elucidating  physical  principles 

The  degree  to  which  a  set  of  inherent  characteristics  fulfills 
requirements. 

Quantitative  objectives  and  requirements  for  product  quality, 
service  quality,  and  process  performance. 

Quantitative  process  performance  objectives  include  quality;  however,  to 
emphasize  the  importance  of  quality  in  the  CMMI  Product  Suite,  the 
phrase  “quality  and  process  performance  objectives”  is  used.  “Process 
performance  objectives”  are  referenced  in  maturity  level  3;  the  term 
“quality  and  process  performance  objectives”  implies  the  use  of 
quantitative  data  and  is  only  used  in  maturity  levels  4  and  5. 
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quality  assurance 

quality  attribute 

quality  control 

quantitative 

management 


quantitative 

objective 

quantitatively 

managed 

reference  model 

relevant  stakeholder 

representation 


A  planned  and  systematic  means  for  assuring  management 
that  the  defined  standards,  practices,  procedures,  and 
methods  of  the  process  are  applied. 

A  property  of  a  product  or  service  by  which  its  quality  will  be 
judged  by  relevant  stakeholders.  Quality  attributes  are 
characterizable  by  some  appropriate  measure. 

Quality  attributes  are  non-functional,  such  as  timeliness,  throughput, 
responsiveness,  security,  modifiability,  reliability,  and  usability.  They  have 
a  significant  influence  on  the  architecture. 

The  operational  techniques  and  activities  that  are  used  to 
fulfill  requirements  for  quality.  (See  also  “quality  assurance.”) 

Managing  a  project  or  work  group  using  statistical  and  other 
quantitative  techniques  to  build  an  understanding  of  the 
performance  or  predicted  performance  of  processes  in 
comparison  to  the  project’s  or  work  group’s  quality  and 
process  performance  objectives,  and  identifying  corrective 
action  that  may  need  to  be  taken.  (See  also  “statistical 
techniques.”) 

Statistical  techniques  used  in  quantitative  management  include  analysis, 
creation,  or  use  of  process  performance  models;  analysis,  creation,  or 
use  of  process  performance  baselines;  use  of  control  charts;  analysis  of 
variance,  regression  analysis;  and  use  of  confidence  intervals  or 
prediction  intervals,  sensitivity  analysis,  simulations,  and  tests  of 
hypotheses. 

Desired  target  value  expressed  using  quantitative 
measures.  (See  also  “measure,”  “process  improvement 
objectives,”  and  “quality  and  process  performance 
objectives.”) 

(See  “quantitative  management.”) 

A  model  that  is  used  as  a  benchmark  for  measuring  an 
attribute. 

A  stakeholder  that  is  identified  for  involvement  in  specified 
activities  and  is  included  in  a  plan.  (See  also  “stakeholder.”) 

The  organization,  use,  and  presentation  of  a  CMM’s 
components. 

Overall,  two  types  of  approaches  to  presenting  best  practices  are  evident: 
the  staged  representation  and  the  continuous  representation. 
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required  CMMI 
components 


requirement 


requirements 

analysis 


requirements 

elicitation 


requirements 

management 


requirements 

traceability 


return  on 
investment 


risk  analysis 
risk  identification 


CMMI  components  that  are  essential  to  achieving  process 
improvement  in  a  given  process  area. 

Specific  goals  and  generic  goals  are  required  model  components.  Goal 
satisfaction  is  used  in  appraisals  as  the  basis  for  deciding  whether  a 
process  area  has  been  satisfied. 

(1)  A  condition  or  capability  needed  by  a  user  to  solve  a 
problem  or  achieve  an  objective.  (2)  A  condition  or  capability 
that  must  be  met  or  possessed  by  a  product,  service, 
product  component,  or  service  component  to  satisfy  a 
supplier  agreement,  standard,  specification,  or  other 
formally  imposed  documents.  (3)  A  documented 
representation  of  a  condition  or  capability  as  in  (1)  or  (2). 
(See  also  “supplier  agreement.”) 

The  determination  of  product  or  service  specific  functional 
and  quality  attribute  characteristics  based  on  analyses  of 
customer  needs,  expectations,  and  constraints;  operational 
concept;  projected  utilization  environments  for  people, 
products,  services,  and  processes;  and  measures  of 
effectiveness.  (See  also  “operational  concept.”) 

Using  systematic  techniques  such  as  prototypes  and 
structured  surveys  to  proactively  identify  and  document 
customer  and  end-user  needs. 

The  management  of  all  requirements  received  by  or 
generated  by  the  project  or  work  group,  including  both 
technical  and  nontechnical  requirements  as  well  as  those 
requirements  levied  on  the  project  or  work  group  by  the 
organization.  (See  also  “nontechnical  requirements.”) 

A  discernable  association  between  requirements  and  related 
requirements,  implementations,  and  verifications.  (See  also 
“bidirectional  traceability”  and  “traceability.”) 

The  ratio  of  revenue  from  output  (product  or  service)  to 
production  costs,  which  determines  whether  an  organization 
benefits  from  performing  an  action  to  produce  something. 

The  evaluation,  classification,  and  prioritization  of  risks. 

An  organized,  thorough  approach  used  to  seek  out  probable 
or  realistic  risks  in  achieving  objectives. 
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risk  management 


senior  manager 


service 


An  organized,  analytic  process  used  to  identify  what  might 
cause  harm  or  loss  (identify  risks);  to  assess  and  quantify 
the  identified  risks;  and  to  develop  and,  if  needed, 
implement  an  appropriate  approach  to  prevent  or  handle 
causes  of  risk  that  could  result  in  significant  harm  or  loss. 

Typically,  risk  management  is  performed  for  the  activities  of  a  project,  a 
work  group,  an  organization,  or  other  organizational  units  that  are 
developing  or  delivering  products  or  services. 

A  management  role  at  a  high  enough  level  in  an  organization 
that  the  primary  focus  of  the  person  filling  the  role  is  the 
long-term  vitality  of  the  organization  rather  than  short-term 
concerns  and  pressures.  (See  also  “higher  level 
management.”) 

A  senior  manager  has  authority  to  direct  the  allocation  or  reallocation  of 
resources  in  support  of  organizational  process  improvement 
effectiveness. 

A  senior  manager  can  be  any  manager  who  satisfies  this  description, 
including  the  head  of  the  organization.  Synonyms  for  senior  manager 
include  “executive”  and  “top-level  manager.”  However,  to  ensure 
consistency  and  usability,  these  synonyms  are  not  used  in  CMMI  models. 

This  term  has  a  special  meaning  in  the  CMMI  Product  Suite  besides  its 
common  standard  English  meaning. 

A  product  that  is  intangible  and  non-storable.  (See  also 
“product,”  “customer,”  and  “work  product.”) 

Services  are  delivered  through  the  use  of  service  systems  that  have  been 
designed  to  satisfy  service  requirements.  (See  also  “service  system.”) 

Many  service  providers  deliver  combinations  of  services  and  goods.  A 
single  service  system  can  deliver  both  types  of  products.  For  example,  a 
training  organization  can  deliver  training  materials  along  with  its  training 
services. 

Services  may  be  delivered  through  combinations  of  manual  and 
automated  processes. 

This  term  has  a  special  meaning  in  the  CMMI  Product  Suite  besides  its 
common  standard  English  meaning. 
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service  agreement 


service  catalog 


service  incident 


service  level 


A  binding,  written  record  of  a  promised  exchange  of  value 
between  a  service  provider  and  a  customer.  (See  also 
“customer.”) 

Service  agreements  can  be  fully  negotiable,  partially  negotiable,  or  non- 
negotiable,  and  they  can  be  drafted  either  by  the  service  provider,  the 
customer,  or  both,  depending  on  the  situation. 

A  “promised  exchange  of  value”  means  a  joint  recognition  and  acceptance 
of  what  each  party  will  provide  to  the  other  to  satisfy  the  agreement. 
Typically,  the  customer  provides  payment  in  return  for  delivered  services, 
but  other  arrangements  are  possible. 

A  “written”  record  need  not  be  contained  in  a  single  document  or  other 
artifact.  Alternatively,  it  may  be  extremely  brief  for  some  types  of  services 
(e.g.,  a  receipt  that  identifies  a  service,  its  price,  its  recipient). 

A  list  or  repository  of  standardized  service  definitions. 

Service  catalogs  can  include  varying  degrees  of  detail  about  available 
service  levels,  quality,  prices,  negotiable/tailorable  items,  and  terms  and 
conditions. 

A  service  catalog  need  not  be  contained  in  a  single  document  or  other 
artifact,  and  can  be  a  combination  of  items  that  provide  equivalent 
information  (such  as  web  pages  linked  to  a  database.)  Alternatively,  for 
some  services  an  effective  catalog  can  be  a  simple  printed  menu  of 
available  services  and  their  prices. 

Service  catalog  information  can  be  partitioned  into  distinct  subsets  to 
support  different  types  of  stakeholders  (e.g.,  customers,  end  users, 
provider  staff,  suppliers). 

An  indication  of  an  actual  or  potential  interference  with  a 
service. 

Service  incidents  can  occur  in  any  service  domain  because  customer  and 
end-user  complaints  are  types  of  incidents  and  even  the  simplest  of 
services  can  generate  complaints. 

The  word  “incident”  can  be  used  in  place  of  “service  incident”  for  brevity 
when  the  context  makes  the  meaning  clear. 

A  defined  magnitude,  degree,  or  quality  of  service  delivery 
performance.  (See  also  “service”  and  “service  level 
measure.”) 
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service  level 
agreement 


service  level 
measure 

service  line 


service  request 


service 

requirements 


A  service  agreement  that  specifies  delivered  services; 
service  measures;  levels  of  acceptable  and  unacceptable 
services;  and  expected  responsibilities,  liabilities,  and 
actions  of  both  the  provider  and  customer  in  anticipated 
situations.  (See  also  “measure,”  “service,”  and  “service 
agreement.”) 

A  service  level  agreement  is  a  kind  of  service  agreement  that  documents 
the  details  indicated  in  the  definition. 

The  use  of  the  term  “service  agreement”  always  includes  “service  level 
agreement”  as  a  subcategory  and  the  former  may  be  used  in  place  of  the 
latter  for  brevity.  However,  “service  level  agreement”  is  the  preferred  term 
when  it  is  desired  to  emphasize  situations  in  which  distinct  levels  of 
acceptable  services  exist,  or  other  details  of  a  service  level  agreement  are 
likely  to  be  important  to  the  discussion. 

A  measure  of  service  delivery  performance  associated  with  a 
service  level.  (See  also  “measure”  and  “service  level.”) 

A  consolidated  and  standardized  set  of  services  and  service 
levels  that  satisfy  specific  needs  of  a  selected  market  or 
mission  area.  (See  also  “product  line”  and  “service  level.”) 

A  communication  from  a  customer  or  end  user  that  one  or 
more  specific  instances  of  service  delivery  are  desired.  (See 
also  “service  agreement.”) 

These  requests  are  made  within  the  context  of  a  service  agreement. 

In  cases  where  services  are  to  be  delivered  continuously  or  periodically, 
some  service  requests  may  be  explicitly  identified  in  the  service 
agreement  itself. 

In  other  cases,  service  requests  that  fall  within  the  scope  of  a  previously 
established  service  agreement  are  generated  over  time  by  customers  or 
end  users  as  their  needs  develop. 

The  complete  set  of  requirements  that  affect  service  delivery 
and  service  system  development.  (See  also  “service 
system.”) 

Service  requirements  include  both  technical  and  nontechnical 
requirements.  Technical  requirements  are  properties  of  the  service  to  be 
delivered  and  the  service  system  needed  to  enable  delivery.  Nontechnical 
requirements  may  include  additional  conditions,  provisions,  commitments, 
and  terms  identified  by  agreements,  and  regulations,  as  well  as  needed 
capabilities  and  conditions  derived  from  business  objectives. 
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service  system 


service  system 
component 


service  system 
consumable 


An  integrated  and  interdependent  combination  of  component 
resources  that  satisfies  service  requirements.  (See  also 
“service  system  component”  and  “service  requirements.”) 

A  service  system  encompasses  everything  required  for  service  delivery, 
including  work  products,  processes,  facilities,  tools,  consumables,  and 
human  resources. 

Note  that  a  service  system  includes  the  people  necessary  to  perform  the 
service  system’s  processes.  In  contexts  where  end  users  perform  some 
processes  for  service  delivery  to  be  accomplished,  those  end  users  are 
also  part  of  the  service  system  (at  least  for  the  duration  of  those 
interactions). 

A  complex  service  system  may  be  divisible  into  multiple  distinct  delivery 
and  support  systems  or  subsystems.  While  these  divisions  and 
distinctions  may  be  significant  to  the  service  provider  organization,  they 
may  not  be  as  meaningful  to  other  stakeholders. 

A  resource  required  for  a  service  system  to  successfully 
deliver  services. 

Some  components  can  remain  owned  by  a  customer,  end  user,  or  third 
party  before  service  delivery  begins  and  after  service  delivery  ends.  (See 
also  “customer”  and  “end  user.”) 

Some  components  can  be  transient  resources  that  are  part  of  the  service 
system  for  a  limited  time  (e.g.,  items  that  are  under  repair  in  a 
maintenance  shop). 

Components  can  include  processes  and  people. 

The  word  “component”  can  be  used  in  place  of  “service  system 
component”  for  brevity  when  the  context  makes  the  meaning  clear. 

The  word  “infrastructure”  can  be  used  to  refer  collectively  to  service 
system  components  that  are  tangible  and  essentially  permanent. 
Depending  on  the  context  and  type  of  service,  infrastructure  can  include 
human  resources. 

A  service  system  component  that  ceases  to  be  available  or 
becomes  permanently  changed  by  its  use  during  the  delivery 
of  a  service. 

Fuel,  office  supplies,  and  disposable  containers  are  examples  of 
commonly  used  consumables.  Particular  types  of  services  can  have  their 
own  specialized  consumables  (e.g.,  a  health  care  service  may  require 
medications  or  blood  supplies). 

People  are  not  consumables,  but  their  labor  time  is  a  consumable. 
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shared  vision 


software 

engineering 


solicitation 


solicitation  package 


special  cause  of 
variation 


specific  goal 


specific  practice 


stable  process 


staged 

representation 


A  common  understanding  of  guiding  principles,  including 
mission,  objectives,  expected  behavior,  values,  and  final 
outcomes,  which  are  developed  and  used  by  a  project  or 
work  group. 

(1)  The  application  of  a  systematic,  disciplined,  quantifiable 
approach  to  the  development,  operation,  and  maintenance 
of  software.  (2)  The  study  of  approaches  as  in  (1 ).  (See  also 
“hardware  engineering,”  and  “systems  engineering.”) 

The  process  of  preparing  a  package  to  be  used  in  selecting 
a  supplier.  (See  also  “solicitation  package.”) 

A  collection  of  formal  documents  that  includes  a  description 
of  the  desired  form  of  response  from  a  potential  supplier,  the 
relevant  statement  of  work  for  the  supplier,  and  required 
provisions  in  the  supplier  agreement. 

A  cause  of  a  defect  that  is  specific  to  some  transient 
circumstance  and  is  not  an  inherent  part  of  a  process.  (See 
also  “common  cause  of  variation.”) 

A  required  model  component  that  describes  the  unique 
characteristics  that  must  be  present  to  satisfy  the  process 
area.  (See  also  “capability  level,”  “generic  goal,” 
“organization’s  business  objectives,”  and  “process  area.”) 

An  expected  model  component  that  is  considered  important 
in  achieving  the  associated  specific  goal.  (See  also  “process 
area”  and  “specific  goal.”) 

The  specific  practices  describe  the  activities  expected  to  result  in 
achievement  of  the  specific  goals  of  a  process  area. 

The  state  in  which  special  causes  of  process  variation  have 
been  removed  and  prevented  from  recurring  so  that  only 
common  causes  of  process  variation  of  the  process  remain. 
(See  also  “capable  process,”  “common  cause  of  variation,” 
“special  cause  of  variation,”  and  “standard  process.”) 

A  model  structure  wherein  attaining  the  goals  of  a  set  of 
process  areas  establishes  a  maturity  level;  each  level  builds 
a  foundation  for  subsequent  levels.  (See  also  “maturity  level” 
and  “process  area.”) 
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stakeholder 


standard  (noun) 


standard  process 


statement  of  work 

statistical  and  other 

quantitative 

techniques 


statistical  process 
control 


A  group  or  individual  that  is  affected  by  or  is  in  some  way 
accountable  for  the  outcome  of  an  undertaking.  (See  also 
“customer”  and  “relevant  stakeholder.”) 

Stakeholders  may  include  project  or  work  group  members,  suppliers, 
customers,  end  users,  and  others. 

This  term  has  a  special  meaning  in  the  CMMI  Product  Suite  besides  its 
common  standard  English  meaning. 

Formal  requirements  developed  and  used  to  prescribe 
consistent  approaches  to  acquisition,  development,  or 
service. 

Examples  of  standards  include  ISO/IEC  standards,  IEEE  standards,  and 
organizational  standards. 

An  operational  definition  of  the  basic  process  that  guides  the 
establishment  of  a  common  process  in  an  organization. 

A  standard  process  describes  the  fundamental  process  elements  that  are 
expected  to  be  incorporated  into  any  defined  process.  It  also  describes 
relationships  (e.g.,  ordering,  interfaces)  among  these  process  elements. 
(See  also  “defined  process.”) 

A  description  of  work  to  be  performed. 

Analytic  techniques  that  enable  accomplishing  an  activity  by 
quantifying  parameters  of  the  task  (e.g.,  inputs,  size,  effort, 
and  performance).  (See  also  “statistical  techniques”  and 
“quantitative  management.”) 

This  term  is  used  in  the  high  maturity  process  areas  where  the  use  of 
statistical  and  other  quantitative  techniques  to  improve  understanding  of 
project,  work,  and  organizational  processes  is  described. 

Examples  of  non-statistical  quantitative  techniques  include  trend  analysis, 
run  charts,  Pareto  analysis,  bar  charts,  radar  charts,  and  data  averaging. 

The  reason  for  using  the  compound  term  “statistical  and  other  quantitative 
techniques”  in  CMMI  is  to  acknowledge  that  while  statistical  techniques 
are  expected,  other  quantitative  techniques  can  also  be  used  effectively. 

Statistically  based  analysis  of  a  process  and  measures  of 
process  performance,  which  identify  common  and  special 
causes  of  variation  in  process  performance  and  maintain 
process  performance  within  limits.  (See  also  “common 
cause  of  variation,”  “special  cause  of  variation,”  and 
“statistical  techniques.”) 
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statistical 

techniques 

subpractice 

subprocess 

supplier 

supplier  agreement 

sustainment 

system  of  systems 


Techniques  adapted  from  the  field  of  mathematical  statistics 
used  for  activities  such  as  characterizing  process 
performance,  understanding  process  variation,  and 
predicting  outcomes. 

Examples  of  statistical  techniques  include  sampling  techniques,  analysis 
of  variance,  chi-squared  tests,  and  process  control  charts. 

An  informative  model  component  that  provides  guidance  for 
interpreting  and  implementing  specific  or  generic  practices. 

Subpractices  may  be  worded  as  if  prescriptive,  but  they  are  actually 
meant  only  to  provide  ideas  that  can  be  useful  for  process  improvement. 

A  process  that  is  part  of  a  larger  process.  (See  also 
“process,”  “process  description,”  and  “process  element.”) 

A  subprocess  may  or  may  not  be  further  decomposed  into  more  granular 
subprocesses  or  process  elements.  The  terms  “process,”  “subprocess,” 
and  “process  element”  form  a  hierarchy  with  “process”  as  the  highest, 
most  general  term,  “subprocesses”  below  it,  and  “process  element”  as  the 
most  specific.  A  subprocess  can  also  be  called  a  process  element  if  it  is 
not  decomposed  into  further  subprocesses. 

(1)  An  entity  delivering  products  or  performing  services 
being  acquired.  (2)  An  individual,  partnership,  company, 
corporation,  association,  or  other  entity  having  an 
agreement  with  an  acquirer  for  the  design,  development, 
manufacture,  maintenance,  modification,  or  supply  of  items 
under  the  terms  of  an  agreement.  (See  also  “acquirer.”) 

A  documented  agreement  between  the  acquirer  and 
supplier.  (See  also  “supplier.”) 

Supplier  agreements  are  also  known  as  contracts,  licenses,  and 
memoranda  of  agreement. 

The  processes  used  to  ensure  that  a  product  or  service 
remains  operational. 

A  set  or  arrangement  of  systems  that  results  when 
independent  and  useful  systems  are  integrated  into  a  large 
system  that  delivers  unique  capabilities. 
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systems 

engineering 


tailoring 


tailoring  guidelines 


target  profile 


target  staging 


The  interdisciplinary  approach  governing  the  total  technical 
and  managerial  effort  required  to  transform  a  set  of 
customer  needs,  expectations,  and  constraints  into  a 
solution  and  to  support  that  solution  throughout  its  life.  (See 
also  “hardware  engineering”  and  “software  engineering.”) 

This  approach  includes  the  definition  of  technical  performance  measures, 
the  integration  of  engineering  specialties  toward  the  establishment  of  an 
architecture,  and  the  definition  of  supporting  lifecycle  processes  that 
balance  cost,  schedule,  and  performance  objectives. 

The  act  of  making,  altering,  or  adapting  something  for  a 
particular  end. 

For  example,  a  project  or  work  group  establishes  its  defined  process  by 
tailoring  from  the  organization’s  set  of  standard  processes  to  meet  its 
objectives,  constraints,  and  environment.  Likewise,  a  service  provider 
tailors  standard  services  for  a  particular  service  agreement. 

Organizational  guidelines  that  enable  projects,  workgroups, 
and  organizational  functions  to  appropriately  adapt  standard 
processes  for  their  use. 

The  organization’s  set  of  standard  processes  is  described  at  a  general 
level  that  may  not  be  directly  usable  to  perform  a  process. 

Tailoring  guidelines  aid  those  who  establish  the  defined  processes  for 
project  or  work  groups.  Tailoring  guidelines  cover  (1)  selecting  a  standard 
process,  (2)  selecting  an  approved  lifecycle  model,  and  (3)  tailoring  the 
selected  standard  process  and  lifecycle  model  to  fit  project  or  work  group 
needs.  Tailoring  guidelines  describe  what  can  and  cannot  be  modified 
and  identify  process  components  that  are  candidates  for  modification. 

A  list  of  process  areas  and  their  corresponding  capability 
levels  that  represent  an  objective  for  process  improvement. 
(See  also  “achievement  profile”  and  “capability  level 
profile.”) 

Target  profiles  are  only  available  when  using  the  continuous 
representation. 

A  sequence  of  target  profiles  that  describes  the  path  of 
process  improvement  to  be  followed  by  the  organization. 
(See  also  “achievement  profile,”  “capability  level  profile,”  and 
“target  profile.”) 

Target  staging  is  only  available  when  using  the  continuous 
representation. 
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team 


technical  data 
package 


A  group  of  people  with  complementary  skills  and  expertise 
who  work  together  to  accomplish  specified  objectives. 

A  team  establishes  and  maintains  a  process  that  identifies  roles, 
responsibilities,  and  interfaces;  is  sufficiently  precise  to  enable  the  team 
to  measure,  manage,  and  improve  their  work  performance;  and  enables 
the  team  to  make  and  defend  their  commitments. 

Collectively,  team  members  provide  skills  and  advocacy  appropriate  to  all 
aspects  of  their  work  (e.g.,  for  the  different  phases  of  a  work  product’s 
life)  and  are  responsible  for  accomplishing  the  specified  objectives. 

Not  every  project  or  work  group  member  must  belong  to  a  team  (e.g.,  a 
person  staffed  to  accomplish  a  task  that  is  largely  self-contained).  Thus,  a 
large  project  or  work  group  can  consist  of  many  teams  as  well  as  project 
staff  not  belonging  to  any  team.  A  smaller  project  or  work  group  can 
consist  of  only  a  single  team  (or  a  single  individual). 

A  collection  of  items  that  can  include  the  following  if  such 
information  is  appropriate  to  the  type  of  product  and  product 
component  (e.g.,  material  and  manufacturing  requirements 
may  not  be  useful  for  product  components  associated  with 
software  services  or  processes): 

•  Product  architecture  description 

•  Allocated  requirements 

•  Product  component  descriptions 

•  Product  related  lifecycle  process  descriptions  if  not 
described  as  separate  product  components 

•  Key  product  characteristics 

•  Required  physical  characteristics  and  constraints 

•  Interface  requirements 

•  Materials  requirements  (bills  of  material  and  material 
characteristics) 

•  Fabrication  and  manufacturing  requirements  (for  both 
the  original  equipment  manufacturer  and  field  support) 

•  Verification  criteria  used  to  ensure  requirements  have 
been  achieved 

•  Conditions  of  use  (environments)  and  operating/usage 
scenarios,  modes  and  states  for  operations,  support, 
training,  manufacturing,  disposal,  and  verifications 
throughout  the  life  of  the  product 

•  Rationale  for  decisions  and  characteristics  (e.g., 
requirements,  requirement  allocations,  design  choices) 
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technical 

performance 


technical 

performance 

measure 

technical 

requirements 

traceability 


trade  study 


training 


unit  testing 


validation 


verification 


Characteristic  of  a  process,  product,  or  service,  generally 
defined  by  a  functional  or  technical  requirement. 

Examples  of  technical  performance  types  include  estimating  accuracy, 
end-user  functions,  security  functions,  response  time,  component 
accuracy,  maximum  weight,  minimum  throughput,  allowable  range. 

Precisely  defined  technical  measure  of  a  requirement, 
capability,  or  some  combination  of  requirements  and 
capabilities.  (See  also  “measure.”) 

Properties  (i.e.,  attributes)  of  products  or  services  to  be 
acquired  or  developed. 

A  discernable  association  among  two  or  more  logical  entities 
such  as  requirements,  system  elements,  verifications,  or 
tasks.  (See  also  “bidirectional  traceability”  and  “requirements 
traceability.”) 

An  evaluation  of  alternatives,  based  on  criteria  and 
systematic  analysis,  to  select  the  best  alternative  for 
attaining  determined  objectives. 

Formal  and  informal  learning  options. 

These  learning  options  can  include  classroom  training,  informal 
mentoring,  web-based  training,  guided  self  study,  and  formalized  on-the- 
job  training  programs. 

The  learning  options  selected  for  each  situation  are  based  on  an 
assessment  of  the  need  for  training  and  the  performance  gap  to  be 
addressed. 

Testing  of  individual  hardware  or  software  units  or  groups  of 
related  units.  (See  also  “acceptance  testing.”) 

Confirmation  that  the  product  or  service,  as  provided  (or  as 
it  will  be  provided),  will  fulfill  its  intended  use. 

In  other  words,  validation  ensures  that  “you  built  the  right  thing.”  (See  also 
“verification.”) 

Confirmation  that  work  products  properly  reflect  the 
requirements  specified  for  them. 

In  other  words,  verification  ensures  that  “you  built  it  right.”  (See  also 
“validation.”) 
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version  control 


work  breakdown 
structure  (WBS) 

work  group 


work  plan 


work  product 


work  product  and 
task  attributes 


work  startup 


The  establishment  and  maintenance  of  baselines  and  the 
identification  of  changes  to  baselines  that  make  it  possible 
to  return  to  the  previous  baseline. 

In  some  contexts,  an  individual  work  product  may  have  its  own  baseline 
and  a  level  of  control  less  than  formal  configuration  control  may  be 
sufficient. 

An  arrangement  of  work  elements  and  their  relationship  to 
each  other  and  to  the  end  product  or  service. 

A  managed  set  of  people  and  other  assigned  resources  that 
delivers  one  or  more  products  or  services  to  a  customer  or 
end  user.  (See  also  “project.”) 

A  work  group  can  be  any  organizational  entity  with  a  defined  purpose, 
whether  or  not  that  entity  appears  on  an  organization  chart.  Work  groups 
can  appear  at  any  level  of  an  organization,  can  contain  other  work  groups, 
and  can  span  organizational  boundaries. 

A  work  group  together  with  its  work  can  be  considered  the  same  as  a 
project  if  it  has  an  intentionally  limited  lifetime. 

A  plan  of  activities  and  related  resource  allocations  for  a 
work  group. 

Work  planning  includes  estimating  the  attributes  of  work  products  and 
tasks,  determining  the  resources  needed,  negotiating  commitments, 
producing  a  schedule,  and  identifying  and  analyzing  risks.  Iterating 
through  these  activities  can  be  necessary  to  establish  the  work  plan. 

A  useful  result  of  a  process. 

This  result  can  include  files,  documents,  products,  parts  of  a  product, 
services,  process  descriptions,  specifications,  and  invoices.  A  key 
distinction  between  a  work  product  and  a  product  component  is  that  a 
work  product  is  not  necessarily  part  of  the  end  product.  (See  also 
“product”  and  “product  component.”) 

In  CMMI  models,  the  definition  of  “work  product”  includes  services, 
however,  the  phrase  “work  products  and  services”  is  sometimes  used  to 
emphasize  the  inclusion  of  services  in  the  discussion. 

Characteristics  of  products,  services,  and  tasks  used  to  help 
in  estimating  work.  These  characteristics  include  items  such 
as  size,  complexity,  weight,  form,  fit,  and  function.  They  are 
typically  used  as  one  input  to  deriving  other  resource 
estimates  (e.g.,  effort,  cost,  schedule). 

When  a  set  of  interrelated  resources  for  a  work  group  is 
directed  to  develop  or  deliver  one  or  more  products  or 
services  for  a  customer  or  end  user.  (See  also  “work  group.”) 
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